00000001:02000400:2.0F:1788586891.650377:0:3130:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788586908.477099:0:3350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788586910.214192:0:3412:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 723 MB/s 00000001:01000000:0.0F:1788586910.464432:0:3412:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 695 MB/s 00000001:01000000:0.0:1788586910.714391:0:3412:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4995 MB/s 00000020:02000000:2.0:1788586911.504925:0:3441:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g97ad22e 00000400:02000000:3.0:1788586912.304928:0:3456:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.114@tcp [8/256/0/180] 00008000:02000000:1.0F:1788586915.888691:0:3606:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788586967.343132:0:5864:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788586975.580701:0:6453:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788586975.580707:0:6453:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788586975.581002:0:6453:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009a261790 00000080:02000400:2.0:1788586975.581016:0:6453:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788586975.587663:0:6453:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788586975.587677:0:6453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788586975.587713:0:6453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000040959404) 00000020:00000080:2.0:1788586975.587731:0:6453:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788586975.603984:0:6453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788586975.604374:0:6453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788586975.623636:0:6453:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788586975.623675:0:6453:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788586975.623697:0:6453:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788586975.623914:0:6453:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788586975.623946:0:6453:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788586975.624294:0:6453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788586975.624301:0:6453:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788586975.624309:0:6453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6343337 00000020:01000004:2.0:1788586975.624317:0:6453:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788586975.624322:0:6453:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788586975.624325:0:6453:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009a261790 from MGS 00000020:01000004:2.0:1788586975.624330:0:6453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788586975.624406:0:6453:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000352f3c20) 00000020:00000080:2.0:1788586975.624418:0:6453:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788586975.624600:0:6453:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a261790 from MGS, refs=2 00080000:01000000:2.0:1788586975.624606:0:6453:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788586975.624612:0:6453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6343345 00000100:00100000:2.0:1788586975.624706:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788586975.624931:0:6453:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788586975.624937:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788586975.625410:0:6453:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788586975.625427:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788586975.626277:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586975.626634:0:6453:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788586975.626640:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788586975.627317:0:6453:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788586975.627324:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788586975.627921:0:6453:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788586975.627928:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788586975.628712:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586975.628716:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586975.628717:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586975.629091:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586975.629094:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586975.629095:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586975.629737:0:6453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788586975.636574:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788586975.878934:0:6453:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3551 MB/s 00000001:01000000:3.0:1788586976.129312:0:6453:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3551 MB/s 00000001:01000000:2.0:1788586976.380788:0:6453:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 609 MB/s 00000001:01000000:2.0:1788586976.633978:0:6453:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 727 MB/s 00080000:10000000:3.0:1788586976.649386:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788586976.669693:0:6453:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788586976.669710:0:6453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788586976.669712:0:6453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788586976.670458:0:6463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788586976.670517:0:6453:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788586976.670565:0:6453:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788586976.670778:0:6453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788586976.670844:0:6453:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788586976.671184:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586976.671328:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788586976.671334:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788586976.672391:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788586976.672409:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788586976.672757:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788586976.672763:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788586976.674072:0:6453:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788586976.674094:0:6453:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.114@tcp' 00000020:01000004:1.0:1788586976.674096:0:6453:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788586976.674200:0:6453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.114@tcp (typ=mgc) 00000020:00000080:1.0:1788586976.674218:0:6453:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.114@tcp (00000000c681cf9b) 00000020:00000080:1.0:1788586976.674234:0:6453:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788586976.674372:0:6453:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c85b1add@MGC192.168.203.114@tcp: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788586976.674551:0:6453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.114@tcp-0 is initialized 00000040:01000000:1.0:1788586976.674558:0:6453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788586976.676113:0:6468:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788586976.676512:0:6469:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788586976.676561:0:6453:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.114@tcp (uuid b5a87955-d364-4ecd-b672-456c35aa135f) 00000020:00000080:2.0:1788586976.676580:0:6453:0:(genops.c:1385:class_connect()) connect: client b5a87955-d364-4ecd-b672-456c35aa135f, cookie 0x419e1ae1f6343353 00000100:00080000:2.0:1788586976.676591:0:6453:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788586976.676596:0:6453:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import 00000000c85b1add using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788586976.676640:0:6453:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fe0ef5b3 x1875469309837440/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788586976.676700:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe0ef5b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5a87955-d364-4ecd-b672-456c35aa135f:3471:1875469309837440:0@lo:250: 00000100:00100000:2.0:1788586976.677125:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788586976.677181:0:6453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b5a87955-d364-4ecd-b672-456c35aa135f->MGS 00000020:01000004:2.0:1788586976.677198:0:6453:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788586976.677220:0:6453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788586976.677232:0:6453:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000058cc3835) 00000020:00000080:2.0:1788586976.677243:0:6453:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788586976.677403:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309837440 00000100:00100000:2.0:1788586976.677410:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309837440 00000100:00100000:2.0:1788586976.677438:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586976.677444:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084d4fc28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3471:x1875469309837440:12345-0@lo:250: 00010000:00080000:2.0:1788586976.677464:0:6464:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b5a87955-d364-4ecd-b672-456c35aa135f@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1788586976.677484:0:6464:0:(genops.c:1385:class_connect()) connect: client b5a87955-d364-4ecd-b672-456c35aa135f, cookie 0x419e1ae1f6343361 00000100:00080000:2.0:1788586976.677637:0:6464:0:(import.c:65:import_set_state_nolock()) 00000000fe569983 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788586976.677695:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084d4fc28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+5:3471:x1875469309837440:12345-0@lo:250: Request processed in 250us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586976.677703:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788586976.677724:0:3471:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788586976.677732:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.114@tcp: connect to target with instance 0 00000100:00080000:0.0:1788586976.677738:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788586976.677741:0:3471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788586976.677743:0:3471:0:(import.c:65:import_set_state_nolock()) 00000000c85b1add MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788586976.677745:0:3471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788586976.677752:0:3471:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788586976.677756:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe0ef5b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5a87955-d364-4ecd-b672-456c35aa135f:3471:1875469309837440:0@lo:250: 00010000:00010000:1.0:1788586976.684535:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586976.693216:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788586976.693488:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788586976.693494:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788586976.696786:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788586976.696857:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788586976.697383:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788586976.697392:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788586976.699044:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586976.699209:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788586976.699215:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788586976.700092:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788586976.700101:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788586976.747454:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586976.747688:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788586976.747694:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788586976.753236:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788586976.753253:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788586976.755098:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586976.755286:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788586976.755292:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788586976.756910:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788586976.756927:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788586976.758271:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586976.758563:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788586976.758570:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788586976.759908:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788586976.760055:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788586976.761665:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788586976.762207:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788586976.762215:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788586976.763780:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788586976.763822:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788586976.815165:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788586976.815392:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788586976.815399:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788586976.818899:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788586976.818917:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788586976.821567:0:6453:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788586976.821583:0:6453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788586976.822955:0:6453:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788586976.822981:0:6453:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788586976.822987:0:6453:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788586976.823142:0:6453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788586976.823191:0:6453:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788586976.823196:0:6453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788586976.823198:0:6453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788586976.823199:0:6453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586976.823200:0:6453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788586976.823201:0:6453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586976.823202:0:6453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586976.823203:0:6453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788586976.823205:0:6453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788586976.823206:0:6453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788586976.823207:0:6453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788586976.823209:0:6453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586976.823210:0:6453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788586976.823213:0:6453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788586976.823215:0:6453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788586976.823216:0:6453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788586976.823217:0:6453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586976.823218:0:6453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788586976.823219:0:6453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586976.823220:0:6453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586976.823221:0:6453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788586976.823222:0:6453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788586976.823223:0:6453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788586976.823224:0:6453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788586976.823225:0:6453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586976.823226:0:6453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788586976.823272:0:6453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788586976.823299:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010ba80ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309837568:0@lo:253: 00000100:00100000:1.0:1788586976.823897:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586976.823952:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 000000004dd88357 going to sleep for 11 seconds 00000100:00100000:2.0:1788586976.823994:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309837568 00000100:00100000:2.0:1788586976.824003:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309837568 00000100:00100000:2.0:1788586976.824055:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586976.824063:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022c22eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+5:6453:x1875469309837568:12345-0@lo:253: 20000000:01000000:2.0:1788586976.824286:0:6467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788586976.824289:0:6467:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788586976.824872:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788586976.825251:0:6467:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788586976.826465:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586976.828342:0:6489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788586976.829639:0:6467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788586976.829646:0:6467:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788586976.829653:0:6467:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788586976.829671:0:6467:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788586976.829693:0:6467:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788586976.831477:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586976.831745:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788586976.831761:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788586976.831849:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788586976.831904:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788586976.831941:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788586976.833786:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788586976.833951:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788586976.834255:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788586976.834264:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788586976.835239:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788586976.835252:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788586976.835368:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788586976.835441:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788586976.835505:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788586976.835512:0:6467:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788586976.835543:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586976.835772:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788586976.835784:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788586976.835986:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788586976.836361:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788586976.836419:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788586976.836432:0:6467:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788586976.836544:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788586976.836555:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788586976.836609:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788586976.836645:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788586976.836681:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788586976.836693:0:6467:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788586976.836883:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788586976.836907:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788586976.836944:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788586976.836981:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788586976.837444:0:6467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788586976.837494:0:6467:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788586976.837501:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788586976.838503:0:6490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788586976.838923:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788586976.838946:0:6467:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.114@tcp for mdt 20000000:01000000:2.0:1788586976.838949:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:2.0:1788586976.838987:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788586976.838995:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788586976.839252:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788586976.839261:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:2.0:1788586976.839384:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788586976.839393:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788586976.839425:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788586976.839458:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788586976.839541:0:6467:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788586976.839544:0:6467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788586976.839548:0:6467:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788586976.839559:0:6467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788586976.839562:0:6467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788586976.839590:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788586976.839593:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788586976.840483:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788586976.840866:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788586976.840902:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788586976.840981:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788586976.840995:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788586976.840998:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788586976.841543:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788586976.841763:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788586976.841917:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788586976.841969:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788586976.841983:0:6467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788586976.841986:0:6467:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788586976.841991:0:6467:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788586976.841994:0:6467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788586976.841998:0:6467:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788586976.842004:0:6467:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788586976.842847:0:6493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788586976.843560:0:6467:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788586976.856078:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788586976.856131:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788586976.856202:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788586976.856224:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788586976.856245:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856282:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856292:0:6467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856298:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856303:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856310:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856316:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000078dfc0a4 already unused, calling callback (00000000158838a5) 00010000:00010000:3.0:1788586976.856320:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856326:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856338:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856345:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586976.856349:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343368 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788586976.856377:0:6467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788586977.166830:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022c22eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+5:6453:x1875469309837568:12345-0@lo:253: Request processed in 342761us (342930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.166849:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586977.167004:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010ba80ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309837568:0@lo:253: 10000000:01000000:2.0:1788586977.167019:0:6453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788586977.167022:0:6453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788586977.167023:0:6453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788586977.167025:0:6453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586977.167026:0:6453:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788586977.167028:0:6453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586977.167029:0:6453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586977.167030:0:6453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788586977.167031:0:6453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788586977.167033:0:6453:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788586977.167034:0:6453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586977.167035:0:6453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788586977.167053:0:6453:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009a261790 from lustre-MDT0000 10000000:01000000:2.0:1788586977.167077:0:6453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788586977.167079:0:6453:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788586977.167083:0:6453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cbf053a99c0 10000000:01000000:2.0:1788586977.167087:0:6453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788586977.167093:0:6453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbf053a99c0 from 1 10000000:01000000:2.0:1788586977.167096:0:6453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788586977.167128:0:6453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.167138:0:6453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.167152:0:6453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586977.167168:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d224c1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309837696:0@lo:101: 00000100:00100000:2.0:1788586977.167201:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.167257:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b5a1973 going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.167347:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309837696 00000100:00100000:3.0:1788586977.167354:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309837696 00000100:00100000:3.0:1788586977.167406:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586977.167414:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013f04f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+5:6453:x1875469309837696:12345-0@lo:101: 00010000:00010000:3.0:1788586977.167426:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586977.167437:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634336f expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.167456:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634336f expref: 6 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.167466:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634336f expref: 6 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.167474:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078dfc0a4, rc 0) 00000100:00100000:3.0:1788586977.167603:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013f04f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+6:6453:x1875469309837696:12345-0@lo:101: Request processed in 189us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.167609:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788586977.167702:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d224c1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309837696:0@lo:101: 00010000:00010000:0.0:1788586977.167714:0:6453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.167722:0:6453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586977.167913:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309837824:0@lo:501: 00000100:00100000:0.0:1788586977.167941:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.168007:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000147cff6e going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.168044:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309837824 00000100:00100000:3.0:1788586977.168049:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309837824 00000100:00100000:3.0:1788586977.168116:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788586977.168123:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075712bd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+6:6453:x1875469309837824:12345-0@lo:501: 00000100:00100000:3.0:1788586977.168338:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075712bd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+6:6453:x1875469309837824:12345-0@lo:501: Request processed in 216us (396us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788586977.168351:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788586977.168416:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309837824:0@lo:501: 10000000:01000000:0.0:1788586977.168438:0:6453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788586977.168465:0:6453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.168473:0:6453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586977.168480:0:6453:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbf11802800 10000000:01000000:0.0:1788586977.168485:0:6453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788586977.168489:0:6453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cbf11802800 10000000:01000000:0.0:1788586977.168491:0:6453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788586977.168494:0:6453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cbf11802800 from 1 10000000:01000000:0.0:1788586977.168496:0:6453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788586977.168515:0:6453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 0000000082576329/0x419e1ae1f634337d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.168533:0:6453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 0000000082576329/0x419e1ae1f634337d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.168540:0:6453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 0000000082576329/0x419e1ae1f634337d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586977.168551:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309837952:0@lo:101: 00000100:00100000:0.0:1788586977.168575:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.168713:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000147cff6e going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.168851:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309837952 00000100:00100000:2.0:1788586977.168856:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309837952 00000100:00100000:2.0:1788586977.168877:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788586977.168881:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013966617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+6:6453:x1875469309837952:12345-0@lo:101: 00010000:00010000:2.0:1788586977.168888:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586977.168899:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b58f58b6/0x419e1ae1f6343384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634337d expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.168913:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b58f58b6/0x419e1ae1f6343384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634337d expref: 7 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.168922:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b58f58b6/0x419e1ae1f6343384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634337d expref: 7 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.168929:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b58f58b6, rc 0) 00000100:00100000:2.0:1788586977.168998:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013966617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+7:6453:x1875469309837952:12345-0@lo:101: Request processed in 116us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.169003:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586977.169118:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309837952:0@lo:101: 00010000:00010000:0.0:1788586977.169128:0:6453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 0000000082576329/0x419e1ae1f634337d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.169135:0:6453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 0000000082576329/0x419e1ae1f634337d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586977.169156:0:6453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788586977.169199:0:6453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 0000000082576329/0x419e1ae1f634337d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.169206:0:6453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 0000000082576329/0x419e1ae1f634337d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586977.169212:0:6453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788586977.169215:0:6453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788586977.169218:0:6453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cbf11802800 10000000:01000000:0.0:1788586977.169221:0:6453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788586977.169223:0:6453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788586977.169225:0:6453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788586977.169238:0:6453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.169243:0:6453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.169249:0:6453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586977.169259:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838080:0@lo:101: 00000100:00100000:0.0:1788586977.169280:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.169304:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000147cff6e going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.169350:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309838080 00000100:00100000:2.0:1788586977.169354:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309838080 00000100:00100000:2.0:1788586977.169380:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788586977.169385:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2406f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+7:6453:x1875469309838080:12345-0@lo:101: 00010000:00010000:2.0:1788586977.169396:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586977.169402:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634338b expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.169414:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634338b expref: 8 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.169420:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634338b expref: 8 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.169426:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000680e0a2e, rc 0) 00000100:00100000:2.0:1788586977.169455:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2406f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+8:6453:x1875469309838080:12345-0@lo:101: Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.169461:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586977.169555:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838080:0@lo:101: 00010000:00010000:0.0:1788586977.169564:0:6453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.169582:0:6453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586977.169619:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838208:0@lo:501: 00000100:00100000:0.0:1788586977.169640:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.169660:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000147cff6e going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.169702:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309838208 00000100:00100000:3.0:1788586977.169706:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309838208 00000100:00100000:3.0:1788586977.169730:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586977.169744:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093602ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+8:6453:x1875469309838208:12345-0@lo:501: 00000100:00100000:3.0:1788586977.169932:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093602ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+9:6453:x1875469309838208:12345-0@lo:501: Request processed in 188us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.169938:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586977.170059:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838208:0@lo:501: 00000100:00100000:0.0:1788586977.170082:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838336:0@lo:503: 00000100:00100000:0.0:1788586977.170113:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.170139:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000147cff6e going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.170182:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309838336 00000100:00100000:3.0:1788586977.170185:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309838336 00000100:00100000:3.0:1788586977.170211:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586977.170216:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa61ea7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+9:6453:x1875469309838336:12345-0@lo:503: 00000100:00100000:3.0:1788586977.170339:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa61ea7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+9:6453:x1875469309838336:12345-0@lo:503: Request processed in 123us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.170345:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586977.170419:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838336:0@lo:503: 00000100:00100000:0.0:1788586977.171056:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:6495:1875469309838464:0@lo:502: 00000100:00100000:0.0:1788586977.171101:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.171171:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000008679443d going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.171206:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309838464 00000100:00100000:3.0:1788586977.171211:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309838464 00000100:00100000:3.0:1788586977.171278:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788586977.171284:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069cfb30d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+9:6495:x1875469309838464:12345-0@lo:502: 00000100:00100000:3.0:1788586977.171459:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069cfb30d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+9:6495:x1875469309838464:12345-0@lo:502: Request processed in 175us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.171466:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788586977.171550:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2005f6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:6495:1875469309838464:0@lo:502: 00000020:01000000:1.0:1788586977.171578:0:6495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586977.171589:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586977.171592:0:6495:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788586977.171596:0:6495:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788586977.171599:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586977.171610:0:6495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000aaeb8fcc) 00000020:00000080:1.0:1788586977.171626:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788586977.171632:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788586977.171698:0:6495:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788586977.171703:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63433a0 00000020:00000080:1.0:1788586977.171967:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788586977.171972:0:6495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586977.171976:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586977.171977:0:6495:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788586977.171980:0:6495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586977.171983:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586977.171985:0:6495:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788586977.171988:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586977.171995:0:6495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c6503556) 00000020:00000080:1.0:1788586977.172005:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788586977.172009:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788586977.172010:0:6495:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788586977.172013:0:6495:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788586977.172020:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788586977.172071:0:6495:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a261790 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788586977.172083:0:6495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000fa10aac0) 00000020:00000080:1.0:1788586977.172092:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788586977.172152:0:6495:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788586977.172160:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f63433b5 00000020:00000080:1.0:1788586977.172239:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788586977.172245:0:6495:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788586977.172248:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x419e1ae1f63433bc 00080000:01000000:1.0:1788586977.172253:0:6495:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788586977.172262:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63433c3 00080000:10000000:1.0:1788586977.172626:0:6495:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788586977.172873:0:6495:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788586977.177384:0:6495:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788586977.240683:0:6495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788586977.241239:0:6495:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788586977.243880:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788586977.244169:0:6495:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788586977.276295:0:6495:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009f9657fd) 00000020:00000080:0.0:1788586977.276320:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788586977.276435:0:6495:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788586977.276443:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63433d1 00000020:00000080:3.0:1788586977.276968:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788586977.278260:0:6495:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586977.307512:0:6495:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586977.339272:0:6495:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586977.375692:0:6495:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586977.404329:0:6495:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788586977.491375:0:6495:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788586977.517561:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x419e1ae1f63433d8 00000020:00000080:3.0:1788586977.517911:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788586977.517925:0:6495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586977.517930:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586977.517932:0:6495:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788586977.517934:0:6495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586977.517938:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586977.517939:0:6495:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788586977.517942:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788586977.517944:0:6495:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788586977.517946:0:6495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586977.517948:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586977.517949:0:6495:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788586977.517951:0:6495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586977.517955:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586977.517956:0:6495:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788586977.517960:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788586977.517993:0:6495:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788586977.518048:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8682426 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:6495:1875469309838592:0@lo:502: 00000100:00100000:3.0:1788586977.518116:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.518201:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c0c02358 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.518235:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309838592 00000100:00100000:2.0:1788586977.518241:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309838592 00000100:00100000:3.0:1788586977.525177:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586977.525196:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3467518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+9:6495:x1875469309838592:12345-0@lo:502: 00000100:00100000:3.0:1788586977.525478:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3467518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+9:6495:x1875469309838592:12345-0@lo:502: Request processed in 290us (7362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.525486:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586977.525581:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8682426 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:6495:1875469309838592:0@lo:502: 00000020:01000000:2.0:1788586977.525614:0:6495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586977.525620:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586977.525622:0:6495:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788586977.525626:0:6495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788586977.525828:0:6453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788586977.525847:0:6453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788586977.525862:0:6453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.525872:0:6453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586977.525879:0:6453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf11802800 from 1 10000000:01000000:1.0:1788586977.525881:0:6453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788586977.525911:0:6453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.525919:0:6453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.525927:0:6453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586977.526017:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccb71263 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838720:0@lo:101: 00000100:00100000:1.0:1788586977.526052:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.533902:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000743cfd86 going to sleep for 11 seconds 00000100:00100000:0.0:1788586977.541538:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309838720 00000100:00100000:0.0:1788586977.541554:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309838720 00000100:00100000:1.0:1788586977.545383:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788586977.545411:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a1a6b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+9:6453:x1875469309838720:12345-0@lo:101: 00010000:00010000:1.0:1788586977.545431:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586977.545449:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63433df expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.545475:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63433df expref: 10 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.545486:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63433df expref: 10 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.545496:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002da508f4, rc 0) 00000100:00100000:1.0:1788586977.545579:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a1a6b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+10:6453:x1875469309838720:12345-0@lo:101: Request processed in 171us (19527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586977.545586:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788586977.545994:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccb71263 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838720:0@lo:101: 00010000:00010000:0.0:1788586977.546014:0:6453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.546024:0:6453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586977.546570:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004620563f pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838848:0@lo:256: 00000100:00100000:0.0:1788586977.546628:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.546687:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1e24faa going to sleep for 11 seconds 00000100:00100000:1.0:1788586977.547378:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309838848 00000100:00100000:1.0:1788586977.547387:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309838848 00000100:00100000:1.0:1788586977.547436:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788586977.547446:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068fd0b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+10:6453:x1875469309838848:12345-0@lo:256: 20000000:01000000:1.0:1788586977.547465:0:6467:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788586977.547471:0:6467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788586977.547578:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068fd0b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+10:6453:x1875469309838848:12345-0@lo:256: Request processed in 133us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586977.547585:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788586977.547629:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004620563f pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838848:0@lo:256: 10000000:01000000:1.0:1788586977.548223:0:6453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788586977.548338:0:6453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.548363:0:6453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586977.548370:0:6453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf11802800 from 1 10000000:01000000:1.0:1788586977.548373:0:6453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788586977.548402:0:6453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.548410:0:6453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.548419:0:6453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586977.548435:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abfe3c51 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838976:0@lo:101: 00000100:00100000:1.0:1788586977.548469:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.548508:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000743cfd86 going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.548587:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309838976 00000100:00100000:3.0:1788586977.548593:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309838976 00000100:00100000:3.0:1788586977.548637:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788586977.548643:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e4674e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+10:6453:x1875469309838976:12345-0@lo:101: 00010000:00010000:3.0:1788586977.548652:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586977.548663:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63433ed expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.548689:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.548698:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.548707:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e54e4e9c, rc 0) 00000100:00100000:3.0:1788586977.548746:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e4674e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+11:6453:x1875469309838976:12345-0@lo:101: Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.548752:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586977.549112:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abfe3c51 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309838976:0@lo:101: 00010000:00010000:0.0:1788586977.549126:0:6453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.549134:0:6453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586977.549182:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b0b1847 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839104:0@lo:501: 00000100:00100000:0.0:1788586977.549209:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.549239:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f4d500d going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.549297:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309839104 00000100:00100000:3.0:1788586977.549302:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309839104 00000100:00100000:3.0:1788586977.549336:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788586977.549342:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000c2e603 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+11:6453:x1875469309839104:12345-0@lo:501: 00000100:00100000:3.0:1788586977.549762:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000c2e603 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+11:6453:x1875469309839104:12345-0@lo:501: Request processed in 420us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.549770:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586977.550294:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b0b1847 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839104:0@lo:501: 00000100:00100000:0.0:1788586977.550330:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b0b1847 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839232:0@lo:503: 00000100:00100000:0.0:1788586977.550374:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.550405:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f4d500d going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.550581:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309839232 00000100:00100000:3.0:1788586977.550587:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309839232 00000100:00100000:3.0:1788586977.550621:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788586977.550628:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d276860c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+11:6453:x1875469309839232:12345-0@lo:503: 00000040:00080000:3.0:1788586977.550665:0:6465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788586977.550701:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d276860c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+11:6453:x1875469309839232:12345-0@lo:503: Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.550708:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586977.550784:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b0b1847 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839232:0@lo:503: 00000040:00080000:1.0:1788586977.552033:0:6499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788586977.552538:0:6453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788586977.552558:0:6453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788586977.552862:0:6453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.552875:0:6453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586977.553080:0:6453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788586977.553085:0:6453:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbf11802800 10000000:01000000:1.0:1788586977.553088:0:6453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbf11802800 10000000:01000000:1.0:1788586977.553091:0:6453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586977.553097:0:6453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf11802800 from 1 10000000:01000000:1.0:1788586977.553099:0:6453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586977.553133:0:6453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.553140:0:6453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.553159:0:6453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586977.553177:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082763ff8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839360:0@lo:101: 00000100:00100000:1.0:1788586977.553234:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.553270:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309839360 00000100:00100000:1.0:1788586977.553272:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f84b74f6 going to sleep for 11 seconds 00000100:00100000:3.0:1788586977.553277:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309839360 00000100:00100000:3.0:1788586977.553337:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788586977.553344:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f3069df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+11:6453:x1875469309839360:12345-0@lo:101: 00010000:00010000:3.0:1788586977.553366:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586977.553377:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63433fb expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.553397:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.553406:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.553412:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c001f820, rc 0) 00000100:00100000:3.0:1788586977.553458:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f3069df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:6453:x1875469309839360:12345-0@lo:101: Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.553466:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788586977.553966:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082763ff8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839360:0@lo:101: 00010000:00010000:1.0:1788586977.553979:0:6453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.553988:0:6453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586977.554034:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082763ff8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839488:0@lo:501: 00000100:00100000:1.0:1788586977.554061:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.554079:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f84b74f6 going to sleep for 11 seconds 00000100:00100000:0.0:1788586977.554119:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309839488 00000100:00100000:0.0:1788586977.554123:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309839488 00000100:00100000:0.0:1788586977.554156:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788586977.554162:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ae809b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:6453:x1875469309839488:12345-0@lo:501: 00000100:00100000:0.0:1788586977.554405:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ae809b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:6453:x1875469309839488:12345-0@lo:501: Request processed in 243us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.554413:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788586977.554601:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082763ff8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839488:0@lo:501: 00000100:00100000:1.0:1788586977.554627:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082763ff8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839616:0@lo:503: 00000100:00100000:1.0:1788586977.554664:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.554684:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f84b74f6 going to sleep for 11 seconds 00000100:00100000:0.0:1788586977.554733:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309839616 00000100:00100000:0.0:1788586977.554738:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309839616 00000100:00100000:0.0:1788586977.554826:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788586977.554833:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d9ec48d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:6453:x1875469309839616:12345-0@lo:503: 00000100:00100000:0.0:1788586977.554995:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d9ec48d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:6453:x1875469309839616:12345-0@lo:503: Request processed in 163us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.555002:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788586977.555080:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082763ff8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309839616:0@lo:503: 00000100:00100000:0.0:1788586977.555470:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b0b1847 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:6500:1875469309839744:0@lo:502: 00000100:00100000:0.0:1788586977.555506:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.555543:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000105e5198 going to sleep for 11 seconds 00000100:00100000:1.0:1788586977.555594:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309839744 00000100:00100000:1.0:1788586977.555598:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309839744 00000100:00100000:1.0:1788586977.555632:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788586977.555639:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9f77150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:6500:x1875469309839744:12345-0@lo:502: 00000100:00100000:1.0:1788586977.555886:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9f77150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:6500:x1875469309839744:12345-0@lo:502: Request processed in 247us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586977.555900:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586977.555983:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b0b1847 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:6500:1875469309839744:0@lo:502: 00000020:01000004:0.0:1788586977.556036:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788586977.556050:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b5094ec0) 00000020:00000080:0.0:1788586977.556067:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788586977.556134:0:6500:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a261790 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788586977.556138:0:6500:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009a261790 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788586977.556140:0:6500:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009a261790 4 00010000:00080000:0.0:1788586977.556167:0:6500:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000014e76758@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788586977.558104:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788586977.558367:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788586977.558401:0:6500:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788586977.558411:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x419e1ae1f6343410 00000100:00080000:1.0:1788586977.558421:0:6500:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586977.558427:0:6500:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000014e76758 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788586977.558460:0:6500:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007f6672a3 x1875469309839872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788586977.558532:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f6672a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469309839872:0@lo:38: 00000100:00100000:0.0:1788586977.558601:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788586977.558669:0:6500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788586977.558870:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309839872 00000100:00100000:3.0:1788586977.558877:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309839872 00000100:00100000:3.0:1788586977.558914:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586977.558920:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b0b1847 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469309839872:12345-0@lo:38: 00000100:00100000:1.0:1788586977.561583:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:6500:1875469309840000:0@lo:502: 00000100:00100000:1.0:1788586977.561661:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.561706:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000743cfd86 going to sleep for 11 seconds 00000100:00100000:0.0:1788586977.564697:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309840000 00000100:00100000:0.0:1788586977.564716:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309840000 00000100:00100000:0.0:1788586977.564775:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788586977.564784:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d78e1ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:6500:x1875469309840000:12345-0@lo:502: 00000100:00100000:0.0:1788586977.565064:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d78e1ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:6500:x1875469309840000:12345-0@lo:502: Request processed in 281us (3402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.565073:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788586977.565254:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b0b1847 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469309839872:12345-0@lo:38: Request processed in 6332us (6652us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788586977.565264:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586977.565431:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:6500:1875469309840000:0@lo:502: 00000040:00080000:1.0:1788586977.565470:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788586977.566134:0:6453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788586977.566155:0:6453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788586977.566173:0:6453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.566183:0:6453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788586977.566222:0:6453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788586977.566224:0:6453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788586977.566225:0:6453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586977.566226:0:6453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586977.566227:0:6453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586977.566228:0:6453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586977.566229:0:6453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788586977.566231:0:6453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788586977.566232:0:6453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586977.566233:0:6453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586977.566235:0:6453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586977.566236:0:6453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788586977.566239:0:6453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788586977.566241:0:6453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788586977.566242:0:6453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788586977.566243:0:6453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586977.566244:0:6453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586977.566245:0:6453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586977.566246:0:6453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586977.566247:0:6453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788586977.566248:0:6453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788586977.566249:0:6453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586977.566250:0:6453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586977.566251:0:6453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586977.566251:0:6453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788586977.566269:0:6453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788586977.566280:0:6453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcc66b0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309840128:0@lo:253: 00000100:00100000:2.0:1788586977.566319:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.566345:0:6453:0:(client.c:2716:ptlrpc_set_wait()) set 000000003bdc9544 going to sleep for 11 seconds 00000100:00100000:1.0:1788586977.566402:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309840128 00000100:00100000:1.0:1788586977.566408:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309840128 00000100:00100000:1.0:1788586977.566478:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788586977.566487:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072ff177c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:6453:x1875469309840128:12345-0@lo:253: 20000000:01000000:1.0:1788586977.566507:0:6465:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788586977.566529:0:6465:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788586977.567361:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788586977.567370:0:3471:0:(import.c:65:import_set_state_nolock()) 0000000014e76758 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788586977.567376:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788586977.567379:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f6672a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469309839872:0@lo:38: 20000000:01000000:2.0:1788586977.592388:0:6465:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788586977.592407:0:6465:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788586977.592478:0:6488:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788586977.592483:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788586977.592504:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.592531:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63433df expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.592550:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.592588:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63433df expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.592603:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63433df expref: 12 pid: 6465 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586977.592615:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004f07a2f9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309840256:0@lo:104: 00000100:00100000:3.0:1788586977.592671:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.592729:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000097a1da4 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.592898:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309840256 00000100:00100000:2.0:1788586977.592907:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309840256 00000100:00100000:2.0:1788586977.592959:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586977.592966:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f875cda0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:6488:x1875469309840256:12345-0@lo:104: 00010000:00010000:2.0:1788586977.592977:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.593029:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586977.593034:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f875cda0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:6488:x1875469309840256:12345-0@lo:104: Request processed in 69us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.593041:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788586977.593127:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586977.593132:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593140:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003849fcea already unused, calling callback (000000009a9b2dd3) 10000000:00010000:1.0:1788586977.593150:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593157:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586977.593163:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586977.593168:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586977.593195:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593201:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586977.593218:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593224:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63433df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63433e6 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593240:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586977.593241:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586977.593243:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586977.593299:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309840384:0@lo:103: 00000100:00100000:1.0:1788586977.593329:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.593394:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309840384 00000100:00100000:1.0:1788586977.593399:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309840384 00010000:00010000:1.0:1788586977.593413:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63433df expref: 13 pid: 6465 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586977.593435:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586977.593448:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fbc6bb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+13:3473:x1875469309840384:12345-0@lo:103: 00010000:00010000:1.0:1788586977.593458:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586977.593462:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63433df expref: 13 pid: 6465 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593472:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63433df expref: 13 pid: 6465 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593487:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593493:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788586977.593504:0:6457:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001023098s 00010000:00010000:1.0:1788586977.593508:0:6457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593514:0:6457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593530:0:6457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593536:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593541:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001cd2a343 already unused, calling callback (00000000158838a5) 00010000:00010000:1.0:1788586977.593544:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593550:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593564:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.593574:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586977.593600:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fbc6bb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+13:3473:x1875469309840384:12345-0@lo:103: Request processed in 153us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586977.593606:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586977.593641:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309840384:0@lo:103: 00010000:00010000:3.0:1788586977.594271:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002da508f4/0x419e1ae1f63433e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63433df expref: 12 pid: 6465 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586977.594285:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004f07a2f9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309840256:0@lo:104: 00010000:00010000:3.0:1788586977.594300:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.594308:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.594313:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586977.594318:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001cd2a343/0x419e1ae1f6343417 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586977.601906:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072ff177c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+11:6453:x1875469309840128:12345-0@lo:253: Request processed in 35412us (35578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586977.601923:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586977.602001:0:6453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcc66b0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:6453:1875469309840128:0@lo:253: 10000000:01000000:2.0:1788586977.602018:0:6453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788586977.602021:0:6453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788586977.602023:0:6453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788586977.602024:0:6453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586977.602026:0:6453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586977.602027:0:6453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586977.602029:0:6453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586977.602030:0:6453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788586977.602032:0:6453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788586977.602033:0:6453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586977.602035:0:6453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586977.602036:0:6453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586977.602038:0:6453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788586977.602052:0:6453:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788586977.606337:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586977.606677:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586977.607235:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586977.607398:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586977.607608:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788586977.608050:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788586977.608885:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788586977.609062:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788586977.609248:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788586977.609423:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788586977.609672:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788586977.609964:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788586977.643296:0:6453:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788586977.673532:0:6453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788586977.673850:0:6506:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788586977.675972:0:6453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788586977.676109:0:6453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788586977.676616:0:6453:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788586977.676623:0:6453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788586977.676751:0:6453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788586977.677922:0:6505:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788586977.677928:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788586977.680099:0:6453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788586977.681019:0:6453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788586977.681064:0:6453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788586977.682479:0:6453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788586977.685707:0:6453:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788586977.694211:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788586977.694364:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788586977.694500:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788586977.694652:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788586977.694823:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788586977.694992:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788586977.695125:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788586977.695256:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788586977.695377:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788586977.695512:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788586977.695679:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788586977.695851:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788586977.695975:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788586977.696111:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788586977.696266:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788586977.696405:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788586977.697045:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788586977.697202:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788586977.697331:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788586977.699275:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788586977.699511:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788586977.699697:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788586977.699955:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788586977.700143:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788586977.700329:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788586977.700691:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788586977.703007:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788586977.703176:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788586977.703319:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788586977.708576:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00010000:00010000:2.0:1788586977.709597:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788586977.709978:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788586977.710162:0:6453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788586977.711228:0:6453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788586977.730508:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788586977.783920:0:6453:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788586977.783964:0:6453:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb62542f7f988 00100000:10000000:3.0:1788586977.783973:0:6453:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788586977.784941:0:6453:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788586977.784958:0:6453:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788586977.784973:0:6453:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788586977.784990:0:6453:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788586977.845862:0:6506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788586977.845944:0:6506:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788586977.845948:0:6506:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788586978.734780:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586979.756133:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586980.778958:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788586981.686880:0:6748:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788586981.804601:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586982.827968:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788586982.955406:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788586982.955417:0:496:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788586982.955425:0:496:0:(import.c:65:import_set_state_nolock()) 0000000014e76758 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788586982.955443:0:496:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000014e76758 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788586982.955473:0:496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000040f19fef x1875469309840640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788586982.955623:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040f19fef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469309840640:0@lo:38: 00000100:00100000:0.0:1788586982.955686:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586982.955715:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309840512:0@lo:400: 00000100:00100000:3.0:1788586982.955758:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586982.955789:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309840640 00000100:00100000:3.0:1788586982.955815:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309840640 00000100:00100000:3.0:1788586982.955842:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586982.955848:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a30ec33b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469309840640:12345-0@lo:38: 00010000:00080000:3.0:1788586982.955867:0:6474:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1788586982.955898:0:6474:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x419e1ae1f634341e 00000004:00100000:3.0:1788586982.955935:0:6474:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788586982.956065:0:6474:0:(import.c:65:import_set_state_nolock()) 000000005a666f15 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586982.956114:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a30ec33b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1875469309840640:12345-0@lo:38: Request processed in 265us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586982.956121:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586982.956143:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309840512 00000100:00100000:3.0:1788586982.956147:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309840512 00000100:00100000:3.0:1788586982.956182:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788586982.956189:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c37618c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+11:3474:x1875469309840512:12345-0@lo:400: 00000100:00100000:3.0:1788586982.956230:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c37618c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+11:3474:x1875469309840512:12345-0@lo:400: Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586982.956237:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788586982.956274:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309840512:0@lo:400: 00010000:00080000:0.0:1788586982.957862:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000040f19fef x1875469309840640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788586982.957889:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788586982.957897:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788586982.957901:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788586982.957904:0:3471:0:(import.c:65:import_set_state_nolock()) 0000000014e76758 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788586982.957909:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040f19fef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469309840640:0@lo:38: 10000000:01000000:1.0:1788586983.466905:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788586983.466913:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf11802800 from 3 10000000:01000000:1.0:1788586983.466918:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788586983.466962:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586983.466973:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586983.466983:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586983.467006:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309840768:0@lo:101: 00000100:00100000:1.0:1788586983.467072:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586983.467158:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ef08a51 going to sleep for 11 seconds 00000100:00100000:2.0:1788586983.467328:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309840768 00000100:00100000:2.0:1788586983.467336:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309840768 00000100:00100000:2.0:1788586983.467388:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788586983.467397:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acc90497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+11:6469:x1875469309840768:12345-0@lo:101: 00010000:00010000:2.0:1788586983.467409:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586983.467422:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343425 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586983.467442:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586983.467453:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586983.467462:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cf22833c, rc 0) 00000100:00100000:2.0:1788586983.467557:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acc90497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:6469:x1875469309840768:12345-0@lo:101: Request processed in 161us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586983.467564:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788586983.472460:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309840768:0@lo:101: 00010000:00010000:1.0:1788586983.472504:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586983.472517:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586983.472593:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309840896:0@lo:256: 00000100:00100000:1.0:1788586983.472653:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586983.472712:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ef08a51 going to sleep for 11 seconds 00000100:00100000:2.0:1788586983.475582:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309840896 00000100:00100000:2.0:1788586983.475597:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309840896 00000100:00100000:2.0:1788586983.475666:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788586983.475675:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d656c3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:6469:x1875469309840896:12345-0@lo:256: 20000000:01000000:2.0:1788586983.475700:0:6467:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788586983.475722:0:6467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788586983.475725:0:6467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788586983.475914:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d656c3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:6469:x1875469309840896:12345-0@lo:256: Request processed in 240us (3260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586983.475927:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586983.476045:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309840896:0@lo:256: 10000000:01000000:3.0:1788586983.476095:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788586983.476105:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586983.476115:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586983.851749:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586984.879156:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586985.899132:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586986.924324:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586987.950543:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586988.079437:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095428f50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309841024:0@lo:400: 00000100:00100000:1.0:1788586988.079527:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586988.079602:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010f3adf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309841152:0@lo:400: 00000100:00100000:1.0:1788586988.079635:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586988.079682:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309841024 00000100:00100000:1.0:1788586988.079690:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309841024 00000100:00100000:1.0:1788586988.079740:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788586988.079749:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007efa5000 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+12:3475:x1875469309841024:12345-0@lo:400: 00000100:00100000:1.0:1788586988.079830:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007efa5000 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+12:3475:x1875469309841024:12345-0@lo:400: Request processed in 81us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586988.079837:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788586988.079876:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309841152 00000100:00100000:1.0:1788586988.079879:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309841152 00000100:00100000:1.0:1788586988.079905:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586988.079911:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d57551c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309841152:12345-0@lo:400: 00000100:00100000:1.0:1788586988.079946:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d57551c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309841152:12345-0@lo:400: Request processed in 35us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586988.079951:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788586988.079986:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000010f3adf8 x1875469309841152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586988.079999:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010f3adf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309841152:0@lo:400: 00000100:00100000:1.0:1788586988.080025:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095428f50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309841024:0@lo:400: 00010000:00010000:1.0:1788586988.973541:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586989.994999:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586991.021456:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788586991.599601:0:7260:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788586991.599605:0:7260:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:1.0:1788586991.600015:0:7260:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008bd034b0 00000020:01000004:1.0:1788586991.600031:0:7260:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1788586991.600042:0:7260:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788586991.600062:0:7260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000002ccb4990) 00000020:00000080:1.0:1788586991.600076:0:7260:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788586991.619300:0:7260:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788586991.622690:0:7260:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788586991.652856:0:7260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788586991.652972:0:7260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788586991.652998:0:7260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788586991.653051:0:7260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788586991.653073:0:7260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788586991.653407:0:7260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788586991.653418:0:7260:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788586991.653439:0:7260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f634343a 00000020:01000004:2.0:1788586991.653526:0:7260:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:2.0:1788586991.653555:0:7260:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788586991.653559:0:7260:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788586991.653564:0:7260:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788586991.653586:0:7260:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:2.0:1788586991.653590:0:7260:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788586991.686966:0:7260:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788586991.687001:0:7260:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.114@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788586991.687005:0:7260:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788586991.687007:0:7260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788586991.687008:0:7260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586991.687010:0:7260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586991.687011:0:7260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586991.687012:0:7260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586991.687013:0:7260:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586991.687014:0:7260:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586991.687016:0:7260:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586991.687017:0:7260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586991.687018:0:7260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788586991.687022:0:7260:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788586991.687025:0:7260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788586991.687030:0:7260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788586991.687031:0:7260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586991.687032:0:7260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586991.687032:0:7260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586991.687033:0:7260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586991.687034:0:7260:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586991.687035:0:7260:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586991.687036:0:7260:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586991.687037:0:7260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586991.687037:0:7260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788586991.687072:0:7260:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788586991.687090:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004f07a2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309841280:0@lo:253: 00000100:00100000:3.0:1788586991.687155:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586991.687223:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309841280 00000100:00100000:1.0:1788586991.687231:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309841280 00000100:00100000:3.0:1788586991.687254:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7c7d210 going to sleep for 11 seconds 00000100:00100000:1.0:1788586991.687284:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788586991.687293:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023410d98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309841280:12345-0@lo:253: 20000000:01000000:1.0:1788586991.687324:0:6465:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788586991.687328:0:6465:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788586991.687333:0:6465:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788586991.687336:0:6465:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788586991.687754:0:6465:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788586991.689545:0:6465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586991.689757:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788586991.689773:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788586991.689843:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788586991.689898:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788586991.689935:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788586991.690040:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788586991.690049:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788586991.690118:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788586991.690127:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788586991.690159:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788586991.690167:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788586991.690197:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788586991.690243:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788586991.691023:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788586991.691037:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788586991.691069:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788586991.691078:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788586991.691118:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788586991.691124:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:1.0:1788586991.691141:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788586991.691145:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788586991.691159:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788586991.691183:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788586991.691202:0:6465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788586991.691751:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788586991.691763:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788586991.691823:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788586991.691881:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788586991.691921:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788586991.691929:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788586991.691960:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788586991.692057:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788586991.692067:0:6465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1788586991.692145:0:6465:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788586991.692154:0:6465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788586991.692834:0:7262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788586991.693215:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788586991.693239:0:6465:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.114@tcp for mdt 20000000:01000000:1.0:1788586991.693241:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788586991.693277:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788586991.693284:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788586991.693534:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788586991.693544:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:1.0:1788586991.693593:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788586991.693664:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788586991.693701:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788586991.693737:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788586991.694121:0:6465:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788586991.694131:0:6465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788586991.695104:0:7263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788586991.695328:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788586991.695354:0:6465:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.114@tcp for mdt 20000000:01000000:1.0:1788586991.695356:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788586991.695392:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788586991.695400:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788586991.695477:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788586991.695485:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:1.0:1788586991.695518:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788586991.695527:0:6465:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788586991.695558:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788586991.695608:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788586991.695631:0:6465:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788586991.695645:0:6465:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788586991.695651:0:6465:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788586991.695658:0:6465:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788586991.696288:0:7264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 22 20000000:00000400:2.0:1788586991.696409:0:6465:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 20000000:01000000:2.0:1788586991.704973:0:6465:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788586991.704980:0:6465:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788586991.704984:0:6465:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788586991.705087:0:6465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788586991.705091:0:6465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788586991.705150:0:6465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788586991.705153:0:6465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788586991.706245:0:7265:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788586991.706334:0:7265:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788586991.706396:0:7265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788586991.707405:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788586991.710572:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788586991.711150:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788586991.711177:0:6465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788586991.711181:0:6465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788586991.712567:0:7266:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788586991.712626:0:7266:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788586991.712791:0:7266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788586991.714053:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788586991.714129:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788586991.714195:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788586991.714209:0:6465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788586991.714211:0:6465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788586991.718207:0:7267:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788586991.718299:0:7267:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788586991.718350:0:7267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788586991.719250:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788586991.719301:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788586991.719338:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 10000000:01000000:3.0:1788586991.719355:0:6465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788586991.719372:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.719407:0:6465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634336f expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.719414:0:6465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634338b expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.719419:0:6465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.719435:0:6465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.719542:0:6465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.719557:0:6465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 12 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586991.719571:0:6465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000253cf710 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6465:1875469309841408:0@lo:104: 00000100:00100000:3.0:1788586991.719775:0:6465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586991.720185:0:6465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634338b expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.720195:0:6465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634338b expref: 12 pid: 6464 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586991.720203:0:6465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771d2aee pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6465:1875469309841536:0@lo:104: 00000100:00100000:3.0:1788586991.720228:0:6465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586991.720480:0:6465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634336f expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.720499:0:6465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634336f expref: 12 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586991.720508:0:6465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000432e6dab pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6465:1875469309841664:0@lo:104: 00000100:00100000:3.0:1788586991.720533:0:6465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586991.720616:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309841408 00000100:00100000:0.0:1788586991.720624:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309841408 00000100:00100000:2.0:1788586991.720742:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309841536 00000100:00100000:2.0:1788586991.720746:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309841536 00000100:00100000:2.0:1788586991.720768:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586991.720775:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b6c0789 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:6465:x1875469309841408:12345-0@lo:104: 00010000:00010000:2.0:1788586991.720787:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.720875:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586991.720887:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b6c0789 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:6465:x1875469309841408:12345-0@lo:104: Request processed in 112us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.720893:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586991.720909:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586991.720915:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000799b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:6465:x1875469309841536:12345-0@lo:104: 00010000:00010000:2.0:1788586991.720921:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.720954:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788586991.720958:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000799b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:6465:x1875469309841536:12345-0@lo:104: Request processed in 44us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.720963:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788586991.720980:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788586991.720984:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721003:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081a0886c already unused, calling callback (000000009a9b2dd3) 10000000:00010000:2.0:1788586991.721006:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721014:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586991.721020:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586991.721026:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586991.721054:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721071:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586991.721089:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721094:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 0000000081a0886c/0x419e1ae1f63433fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343402 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721106:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586991.721108:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721114:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005218c1e9 already unused, calling callback (000000009a9b2dd3) 10000000:00010000:2.0:1788586991.721116:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721122:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586991.721127:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586991.721131:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586991.721147:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721152:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586991.721164:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721169:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 000000005218c1e9/0x419e1ae1f634338b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343392 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721185:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586991.721187:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586991.721188:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586991.721207:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcc66b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309841792:0@lo:103: 00000100:00100000:2.0:1788586991.721234:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586991.721271:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb3431dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309841920:0@lo:103: 00000100:00100000:2.0:1788586991.721292:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586991.721325:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309841792 00000100:00100000:2.0:1788586991.721329:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309841792 00010000:00010000:2.0:1788586991.721347:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 13 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586991.721366:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309841920 00000100:00100000:2.0:1788586991.721369:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309841920 00010000:00010000:2.0:1788586991.721378:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634338b expref: 14 pid: 6464 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586991.721389:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586991.721393:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a6892d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+14:3473:x1875469309841792:12345-0@lo:103: 00010000:00010000:2.0:1788586991.721402:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586991.721406:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 14 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721414:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 14 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721439:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586991.721722:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a6892d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+14:3473:x1875469309841792:12345-0@lo:103: Request processed in 328us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.721735:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586991.721749:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586991.721755:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f86ecb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+13:3474:x1875469309841920:12345-0@lo:103: 00010000:00010000:2.0:1788586991.721775:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586991.721780:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634338b expref: 13 pid: 6464 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721787:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634338b expref: 13 pid: 6464 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.721960:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586991.722055:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f86ecb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+13:3474:x1875469309841920:12345-0@lo:103: Request processed in 299us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.722061:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586991.722103:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb3431dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309841920:0@lo:103: 00000100:00100000:2.0:1788586991.722128:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcc66b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309841792:0@lo:103: 00010000:00010000:1.0:1788586991.722205:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586991.722313:0:6465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000091f5bb47 going to sleep for 11 seconds 00010000:00010000:3.0:1788586991.722326:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c001f820/0x419e1ae1f6343402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63433fb expref: 12 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586991.722337:0:6465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000253cf710 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6465:1875469309841408:0@lo:104: 00010000:00010000:3.0:1788586991.722346:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000680e0a2e/0x419e1ae1f6343392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634338b expref: 11 pid: 6464 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586991.722353:0:6465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771d2aee pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6465:1875469309841536:0@lo:104: 00000100:00100000:0.0:1788586991.722489:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309841664 00000100:00100000:0.0:1788586991.722495:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309841664 00000100:00100000:0.0:1788586991.722518:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788586991.722524:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e86ec007 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6465:x1875469309841664:12345-0@lo:104: 00010000:00010000:0.0:1788586991.722534:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.722604:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586991.722608:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e86ec007 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6465:x1875469309841664:12345-0@lo:104: Request processed in 86us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586991.722615:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788586991.722772:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586991.722777:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.722820:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a26a8be8 already unused, calling callback (000000009a9b2dd3) 10000000:00010000:1.0:1788586991.722824:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.722839:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586991.722845:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586991.722850:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586991.722884:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.722891:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586991.722905:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.722911:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634336f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343376 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.722926:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586991.722928:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586991.722930:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586991.723126:0:6465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000432e6dab pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6465:1875469309841664:0@lo:104: 00010000:00010000:3.0:1788586991.723146:0:6465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586991.723427:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095428f50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309842048:0@lo:103: 00000100:00100000:2.0:1788586991.723469:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586991.724097:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309842048 00000100:00100000:1.0:1788586991.724106:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309842048 00010000:00010000:1.0:1788586991.724137:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634336f expref: 11 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586991.724278:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788586991.724295:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc66b0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+11:3475:x1875469309842048:12345-0@lo:103: 00010000:00010000:1.0:1788586991.724308:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586991.724312:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634336f expref: 11 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724322:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634336f expref: 11 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724337:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078dfc0a4/0x419e1ae1f6343376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634336f expref: 11 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724352:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724358:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724372:0:6457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724378:0:6457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724383:0:6457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724389:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724394:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000077fa61a3 already unused, calling callback (00000000158838a5) 00010000:00010000:1.0:1788586991.724397:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724434:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724447:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.724456:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586991.724505:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc66b0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+10:3475:x1875469309842048:12345-0@lo:103: Request processed in 212us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586991.724512:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788586991.724558:0:6465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.724566:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.724571:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077fa61a3/0x419e1ae1f6343441 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788586991.724589:0:6465:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788586991.725108:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095428f50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309842048:0@lo:103: 00000100:00100000:3.0:1788586991.781190:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023410d98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+9:7260:x1875469309841280:12345-0@lo:253: Request processed in 93889us (94025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.781208:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788586991.781328:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004f07a2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309841280:0@lo:253: 10000000:01000000:1.0:1788586991.781344:0:7260:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788586991.781347:0:7260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788586991.781349:0:7260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788586991.781350:0:7260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586991.781351:0:7260:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788586991.781352:0:7260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586991.781354:0:7260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586991.781355:0:7260:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788586991.781356:0:7260:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788586991.781358:0:7260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586991.781359:0:7260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788586991.781381:0:7260:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008bd034b0 from lustre-MDT0001 10000000:01000000:1.0:1788586991.781406:0:7260:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788586991.781409:0:7260:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788586991.781416:0:7260:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf053a99c0 local copy 10000000:01000000:1.0:1788586991.781431:0:7260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788586991.781475:0:7260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.781486:0:7260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.781510:0:7260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586991.781529:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010f3adf8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842176:0@lo:101: 00000100:00100000:1.0:1788586991.781563:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586991.781616:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293ce041 going to sleep for 11 seconds 00000100:00100000:3.0:1788586991.781952:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309842176 00000100:00100000:3.0:1788586991.781958:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309842176 00000100:00100000:3.0:1788586991.782009:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788586991.782016:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e52c07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+9:7260:x1875469309842176:12345-0@lo:101: 00010000:00010000:3.0:1788586991.782029:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586991.782041:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000077fa61a3/0x419e1ae1f634344f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343448 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.782063:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077fa61a3/0x419e1ae1f634344f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343448 expref: 10 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.782072:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000077fa61a3/0x419e1ae1f634344f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343448 expref: 10 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.782081:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000077fa61a3, rc 0) 00000100:00100000:3.0:1788586991.782128:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e52c07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+10:7260:x1875469309842176:12345-0@lo:101: Request processed in 113us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.782134:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788586991.782286:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010f3adf8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842176:0@lo:101: 00010000:00010000:0.0:1788586991.782301:0:7260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.782310:0:7260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586991.782410:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025177df5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842304:0@lo:501: 00000100:00100000:0.0:1788586991.782453:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586991.782486:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 0000000091533f35 going to sleep for 11 seconds 00000100:00100000:3.0:1788586991.782588:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309842304 00000100:00100000:3.0:1788586991.782593:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309842304 00000100:00100000:3.0:1788586991.782625:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788586991.782631:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000189150b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+10:7260:x1875469309842304:12345-0@lo:501: 00000100:00100000:3.0:1788586991.783195:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000189150b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+10:7260:x1875469309842304:12345-0@lo:501: Request processed in 563us (740us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788586991.783203:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788586991.783385:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025177df5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842304:0@lo:501: 10000000:01000000:0.0:1788586991.783400:0:7260:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788586991.783442:0:7260:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788586991.783447:0:7260:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.783457:0:7260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.783530:0:7260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.783601:0:7260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788586991.783624:0:7260:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbf04818800 10000000:01000000:0.0:1788586991.783630:0:7260:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788586991.783643:0:7260:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cbf053a99c0 10000000:01000000:0.0:1788586991.783646:0:7260:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788586991.783649:0:7260:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cbf053a99c0 from 1 10000000:01000000:0.0:1788586991.783652:0:7260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788586991.783842:0:7260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000004679ed6d/0x419e1ae1f6343456 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.783851:0:7260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000004679ed6d/0x419e1ae1f6343456 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.783861:0:7260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000004679ed6d/0x419e1ae1f6343456 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586991.783876:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025177df5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842432:0@lo:101: 00000100:00100000:0.0:1788586991.783915:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586991.783953:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e3371b71 going to sleep for 11 seconds 00000100:00100000:3.0:1788586991.784104:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309842432 00000100:00100000:3.0:1788586991.784116:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309842432 00000100:00100000:3.0:1788586991.784160:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586991.784168:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e79dcffb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+10:7260:x1875469309842432:12345-0@lo:101: 00010000:00010000:3.0:1788586991.784177:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586991.784190:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c001f820/0x419e1ae1f634345d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343456 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.784210:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c001f820/0x419e1ae1f634345d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343456 expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.784219:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c001f820/0x419e1ae1f634345d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343456 expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.784226:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c001f820, rc 0) 00000100:00100000:3.0:1788586991.784258:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e79dcffb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+11:7260:x1875469309842432:12345-0@lo:101: Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.784264:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788586991.784461:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025177df5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842432:0@lo:101: 00010000:00010000:0.0:1788586991.784543:0:7260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000004679ed6d/0x419e1ae1f6343456 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634345d expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.784551:0:7260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000004679ed6d/0x419e1ae1f6343456 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634345d expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586991.784567:0:7260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788586991.784582:0:7260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000004679ed6d/0x419e1ae1f6343456 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634345d expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.784596:0:7260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000004679ed6d/0x419e1ae1f6343456 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634345d expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586991.784603:0:7260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cbf04818800 10000000:01000000:0.0:1788586991.784606:0:7260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788586991.784610:0:7260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cbf04818800 from 1 10000000:01000000:0.0:1788586991.784612:0:7260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788586991.784627:0:7260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000d42bab70/0x419e1ae1f6343464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.784822:0:7260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000d42bab70/0x419e1ae1f6343464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586991.784832:0:7260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000d42bab70/0x419e1ae1f6343464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586991.784845:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025177df5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842560:0@lo:101: 00000100:00100000:0.0:1788586991.784874:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586991.784944:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e3371b71 going to sleep for 11 seconds 00010000:00010000:1.0:1788586991.785088:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586991.785095:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.785101:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000006b95312 already unused, calling callback (000000009a9b2dd3) 10000000:00010000:1.0:1788586991.785104:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.785111:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586991.785116:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586991.785121:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586991.785140:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.785145:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586991.785165:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.785171:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f6343448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f634344f expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.785193:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586991.785195:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586991.785196:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586991.785244:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004212ee9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309842688:0@lo:103: 00000100:00100000:2.0:1788586991.785275:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586991.785350:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309842688 00000100:00100000:1.0:1788586991.785355:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309842688 00000100:00100000:1.0:1788586991.785400:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586991.785408:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb3431dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+11:3472:x1875469309842688:12345-0@lo:103: 00010000:00010000:1.0:1788586991.785416:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586991.785447:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077fa61a3/0x419e1ae1f634344f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343448 expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.785461:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586991.785501:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb3431dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+10:3472:x1875469309842688:12345-0@lo:103: Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586991.785507:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586991.785630:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004212ee9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309842688:0@lo:103: 00000100:00100000:3.0:1788586991.786152:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309842560 00000100:00100000:3.0:1788586991.786158:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309842560 00000100:00100000:3.0:1788586991.786237:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788586991.786245:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c314a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+10:7260:x1875469309842560:12345-0@lo:101: 00010000:00010000:3.0:1788586991.786256:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586991.786267:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cd2a343/0x419e1ae1f634346b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343464 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.786286:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cd2a343/0x419e1ae1f634346b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343464 expref: 11 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.786295:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cd2a343/0x419e1ae1f634346b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343464 expref: 11 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.786317:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cd2a343, rc 0) 00000100:00100000:3.0:1788586991.786363:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c314a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+11:7260:x1875469309842560:12345-0@lo:101: Request processed in 120us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.786369:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788586991.786593:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025177df5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842560:0@lo:101: 00010000:00010000:1.0:1788586991.786608:0:7260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000d42bab70/0x419e1ae1f6343464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.786615:0:7260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000d42bab70/0x419e1ae1f6343464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586991.786629:0:7260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788586991.786652:0:7260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000d42bab70/0x419e1ae1f6343464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.786658:0:7260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000d42bab70/0x419e1ae1f6343464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586991.786851:0:7260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788586991.786855:0:7260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586991.786860:0:7260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cbf04818800 10000000:01000000:1.0:1788586991.786863:0:7260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788586991.786866:0:7260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788586991.786868:0:7260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788586991.786891:0:7260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 0000000023f54d9c/0x419e1ae1f6343472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.786896:0:7260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 0000000023f54d9c/0x419e1ae1f6343472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.786903:0:7260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 0000000023f54d9c/0x419e1ae1f6343472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586991.786917:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce90444b pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842816:0@lo:101: 00000100:00100000:1.0:1788586991.786949:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586991.786979:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293ce041 going to sleep for 11 seconds 00000100:00100000:3.0:1788586991.787077:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309842816 00000100:00100000:3.0:1788586991.787082:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309842816 00000100:00100000:3.0:1788586991.787107:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586991.787112:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0356f65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+11:7260:x1875469309842816:12345-0@lo:101: 00010000:00010000:3.0:1788586991.787118:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586991.787126:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c0e5a6f/0x419e1ae1f6343479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343472 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.787138:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c0e5a6f/0x419e1ae1f6343479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.787144:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c0e5a6f/0x419e1ae1f6343479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.787150:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c0e5a6f, rc 0) 00000100:00100000:3.0:1788586991.787180:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0356f65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309842816:12345-0@lo:101: Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.787187:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788586991.787251:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce90444b pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842816:0@lo:101: 00010000:00010000:1.0:1788586991.787261:0:7260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 0000000023f54d9c/0x419e1ae1f6343472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586991.787268:0:7260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 0000000023f54d9c/0x419e1ae1f6343472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586991.787371:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce90444b pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842944:0@lo:501: 00000100:00100000:1.0:1788586991.787395:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586991.787953:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293ce041 going to sleep for 11 seconds 00000100:00100000:3.0:1788586991.788080:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309842944 00000100:00100000:3.0:1788586991.788087:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309842944 00000100:00100000:3.0:1788586991.788113:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788586991.788119:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ff9fb22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309842944:12345-0@lo:501: 00000100:00100000:3.0:1788586991.788397:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ff9fb22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309842944:12345-0@lo:501: Request processed in 278us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.788412:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788586991.791982:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce90444b pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309842944:0@lo:501: 00000100:00100000:0.0:1788586991.792343:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c654a3cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843072:0@lo:503: 00000100:00100000:0.0:1788586991.792442:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586991.792679:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af268ca1 going to sleep for 11 seconds 00000100:00100000:3.0:1788586991.794147:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309843072 00000100:00100000:3.0:1788586991.794161:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309843072 00000100:00100000:3.0:1788586991.794266:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788586991.794276:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ff0e728 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309843072:12345-0@lo:503: 00000100:00100000:3.0:1788586991.794533:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ff0e728 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309843072:12345-0@lo:503: Request processed in 259us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.794541:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788586991.794642:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c654a3cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843072:0@lo:503: 00000040:00080000:1.0:1788586991.795158:0:7260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788586991.795236:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001191f59c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843200:0@lo:502: 00000100:00100000:1.0:1788586991.795287:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586991.796263:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293ce041 going to sleep for 11 seconds 00000100:00100000:0.0:1788586991.796375:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309843200 00000100:00100000:0.0:1788586991.796384:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309843200 00000100:00100000:0.0:1788586991.796435:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788586991.796443:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002459f352 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309843200:12345-0@lo:502: 00000100:00100000:0.0:1788586991.797108:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002459f352 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309843200:12345-0@lo:502: Request processed in 663us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586991.797124:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788586991.797236:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001191f59c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843200:0@lo:502: 00000040:00080000:1.0:1788586991.797530:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788586991.797583:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788586991.797631:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788586991.798025:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788586991.798065:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788586991.798114:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788586991.798151:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788586991.798185:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788586991.798234:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788586991.798272:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788586991.798305:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788586991.798373:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788586991.798410:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788586991.798478:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788586991.798532:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788586991.798572:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788586991.798605:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788586991.799108:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788586991.799161:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788586991.799195:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788586991.799247:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788586991.799285:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788586991.799333:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788586991.799380:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001191f59c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843328:0@lo:502: 00000100:00100000:1.0:1788586991.799780:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586991.800090:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309843328 00000100:00100000:3.0:1788586991.800098:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309843328 00000100:00100000:0.0:1788586991.800170:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788586991.800196:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000acb8ad2f going to sleep for 11 seconds 00000100:00100000:0.0:1788586991.800213:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b993baf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309843328:12345-0@lo:502: 00000100:00100000:0.0:1788586991.800574:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b993baf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309843328:12345-0@lo:502: Request processed in 395us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586991.800582:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788586991.801139:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001191f59c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843328:0@lo:502: 00000040:00080000:2.0:1788586991.801377:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788586991.801392:0:7260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788586991.802258:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586991.802271:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586991.802273:0:7269:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788586991.802278:0:7269:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788586991.802280:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586991.802293:0:7269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000005d2c287c) 00000020:00000080:1.0:1788586991.802312:0:7269:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788586991.802318:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788586991.802402:0:7269:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788586991.802410:0:7269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f6343487 00000020:00000080:1.0:1788586991.802929:0:7269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788586991.802935:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586991.802939:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586991.802940:0:7269:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788586991.802943:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586991.802946:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586991.802947:0:7269:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788586991.802951:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586991.802958:0:7269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000069d1ba61) 00000020:00000080:1.0:1788586991.802969:0:7269:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788586991.802973:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788586991.802975:0:7269:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788586991.802977:0:7269:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788586991.802983:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788586991.803098:0:7269:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008bd034b0 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788586991.803111:0:7269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000005b266ca3) 00000020:00000080:1.0:1788586991.803120:0:7269:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788586991.803208:0:7269:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788586991.803214:0:7269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f634349c 00000020:00000080:1.0:1788586991.803320:0:7269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788586991.803326:0:7269:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788586991.803331:0:7269:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x419e1ae1f63434a3 00080000:01000000:1.0:1788586991.803336:0:7269:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788586991.803339:0:7269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f63434aa 00080000:10000000:2.0:1788586991.808162:0:7269:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788586991.808343:0:7269:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788586991.908590:0:7269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788586991.909038:0:7269:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788586991.916858:0:7269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788586991.919952:0:7269:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:1.0:1788586992.049083:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788586992.107622:0:7269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788586992.107645:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586992.107651:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586992.107653:0:7269:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788586992.107658:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586992.107663:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586992.107664:0:7269:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788586992.107667:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788586992.107672:0:7269:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:00000080:0.0:1788586992.107697:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788586992.107709:0:7269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000091f4ee32) 00000020:00000080:0.0:1788586992.107727:0:7269:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788586992.107731:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788586992.107783:0:7269:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788586992.107790:0:7269:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788586992.107823:0:7269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f63434b8 00010000:00080000:0.0:1788586992.107851:0:7269:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d5e4d765@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788586992.112990:0:7269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788586992.121432:0:7269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788586992.121450:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788586992.121490:0:7269:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788586992.121511:0:7269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f63434bf 00000100:00080000:1.0:1788586992.121522:0:7269:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586992.121527:0:7269:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000d5e4d765 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788586992.121562:0:7269:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001191f59c x1875469309843456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788586992.121626:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001191f59c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469309843456:0@lo:38: 00000100:00100000:0.0:1788586992.121768:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788586992.122279:0:7269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788586992.122449:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309843584:0@lo:400: 00000100:00100000:1.0:1788586992.122486:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.122525:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309843584 00000100:00100000:1.0:1788586992.122531:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309843584 00000100:00100000:1.0:1788586992.122574:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586992.122581:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee38980e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309843584:12345-0@lo:400: 00000100:00100000:1.0:1788586992.122628:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee38980e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309843584:12345-0@lo:400: Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.122644:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788586992.122674:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ea08e9ef x1875469309843584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586992.122701:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309843584:0@lo:400: 00000020:01000000:1.0:1788586992.122762:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586992.122766:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586992.122769:0:7269:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788586992.122771:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788586992.122773:0:7269:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788586992.122775:0:7269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788586992.122776:0:7269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788586992.122778:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788586992.122780:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586992.122781:0:7269:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788586992.122783:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586992.122787:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586992.122788:0:7269:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788586992.122791:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788586992.122860:0:7269:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788586992.122870:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586992.122990:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586992.122992:0:7269:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788586992.122996:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586992.122999:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586992.123000:0:7269:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788586992.123003:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788586992.123005:0:7269:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788586992.123097:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586992.123100:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586992.123101:0:7269:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788586992.123103:0:7269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1788586992.123152:0:7260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788586992.123176:0:7260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788586992.123191:0:7260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 0000000023f54d9c/0x419e1ae1f6343472 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.123207:0:7260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 0000000023f54d9c/0x419e1ae1f6343472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586992.123215:0:7260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf04818800 from 1 10000000:01000000:1.0:1788586992.123218:0:7260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788586992.123243:0:7260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.123250:0:7260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.123260:0:7260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586992.123273:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843712:0@lo:101: 00000100:00100000:1.0:1788586992.123374:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.123391:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005452502 going to sleep for 11 seconds 00000100:00100000:0.0:1788586992.123716:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309843712 00000100:00100000:0.0:1788586992.123722:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309843712 00000100:00100000:0.0:1788586992.123758:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586992.123764:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065f0b7be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+12:7260:x1875469309843712:12345-0@lo:101: 00010000:00010000:0.0:1788586992.123773:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586992.123784:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63434c6 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.123822:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.123832:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.123841:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc48c4b3, rc 0) 00000100:00100000:0.0:1788586992.123869:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065f0b7be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+13:7260:x1875469309843712:12345-0@lo:101: Request processed in 105us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.123884:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788586992.124017:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843712:0@lo:101: 00010000:00010000:1.0:1788586992.124031:0:7260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.124039:0:7260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586992.124748:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309843456 00000100:00100000:3.0:1788586992.124755:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309843456 00000100:00100000:3.0:1788586992.124852:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586992.124858:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b2549e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469309843456:12345-0@lo:38: 00010000:00080000:3.0:1788586992.124887:0:6477:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1788586992.124916:0:6477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f63434d4 00000004:00100000:3.0:1788586992.124930:0:6477:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788586992.124936:0:6477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788586992.125260:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843840:0@lo:256: 00000100:00100000:1.0:1788586992.125375:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.125412:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005452502 going to sleep for 11 seconds 00000100:00100000:3.0:1788586992.126401:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309843840 00000100:00100000:3.0:1788586992.126410:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309843840 00000100:00100000:3.0:1788586992.126472:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788586992.126481:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b442d16d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+13:7260:x1875469309843840:12345-0@lo:256: 20000000:01000000:3.0:1788586992.126501:0:6465:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788586992.126522:0:6465:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788586992.126526:0:6465:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788586992.126735:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b442d16d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+13:7260:x1875469309843840:12345-0@lo:256: Request processed in 151us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586992.126751:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788586992.126978:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843840:0@lo:256: 10000000:01000000:1.0:1788586992.127723:0:7260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788586992.128471:0:7260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.128485:0:7260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586992.129205:0:7260:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf04818800 from 1 10000000:01000000:1.0:1788586992.129210:0:7260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788586992.129245:0:7260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.129255:0:7260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.129265:0:7260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586992.129285:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843968:0@lo:101: 00000100:00100000:1.0:1788586992.129967:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.130015:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005452502 going to sleep for 11 seconds 00000100:00100000:1.0:1788586992.130046:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309843968 00000100:00100000:1.0:1788586992.130054:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309843968 00000100:00100000:1.0:1788586992.130093:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788586992.130101:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2d1e9b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+13:7260:x1875469309843968:12345-0@lo:101: 00010000:00010000:1.0:1788586992.130116:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586992.130129:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63434db expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.130171:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63434db expref: 14 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.130182:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63434db expref: 14 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.130190:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002da508f4, rc 0) 00000100:00100000:1.0:1788586992.130228:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2d1e9b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:7260:x1875469309843968:12345-0@lo:101: Request processed in 128us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.130235:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788586992.130288:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309843968:0@lo:101: 00010000:00010000:1.0:1788586992.132731:0:7260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.132752:0:7260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586992.133555:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844096:0@lo:501: 00000100:00100000:1.0:1788586992.133621:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.133674:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309844096 00000100:00100000:1.0:1788586992.133680:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309844096 00000100:00100000:1.0:1788586992.133719:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788586992.133726:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008da6232a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:7260:x1875469309844096:12345-0@lo:501: 00000100:00100000:1.0:1788586992.133892:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008da6232a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:7260:x1875469309844096:12345-0@lo:501: Request processed in 166us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.133900:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788586992.133951:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005452502 going to sleep for 11 seconds 00000100:00100000:1.0:1788586992.133971:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844096:0@lo:501: 00000100:00100000:1.0:1788586992.134001:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844224:0@lo:503: 00000100:00100000:1.0:1788586992.134034:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.134055:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309844224 00000100:00100000:1.0:1788586992.134058:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309844224 00000100:00100000:1.0:1788586992.134076:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788586992.134080:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a2d4a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+14:7260:x1875469309844224:12345-0@lo:503: 00000040:00080000:1.0:1788586992.134110:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788586992.134138:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a2d4a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+14:7260:x1875469309844224:12345-0@lo:503: Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.134143:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788586992.134168:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005452502 going to sleep for 11 seconds 00000100:00100000:1.0:1788586992.134178:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844224:0@lo:503: 00000040:00080000:1.0:1788586992.135249:0:7260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586992.135413:0:7260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788586992.135494:0:7260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586992.136548:0:7275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788586992.139478:0:7260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788586992.139518:0:7260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788586992.139533:0:7260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.139546:0:7260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586992.139598:0:7260:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788586992.139601:0:7260:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbf04818800 10000000:01000000:0.0:1788586992.139612:0:7260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbf04818800 10000000:01000000:0.0:1788586992.139617:0:7260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788586992.139623:0:7260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf04818800 from 1 10000000:01000000:0.0:1788586992.139625:0:7260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788586992.139672:0:7260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000001a6c6466/0x419e1ae1f63434e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.139680:0:7260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000001a6c6466/0x419e1ae1f63434e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.139691:0:7260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000001a6c6466/0x419e1ae1f63434e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586992.139713:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7eea589 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844352:0@lo:101: 00000100:00100000:0.0:1788586992.139783:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586992.139842:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077c6ec59 going to sleep for 11 seconds 00000100:00100000:3.0:1788586992.140071:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309844352 00000100:00100000:3.0:1788586992.140080:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309844352 00000100:00100000:3.0:1788586992.140167:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788586992.140176:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc27146e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:7260:x1875469309844352:12345-0@lo:101: 00010000:00010000:3.0:1788586992.140189:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586992.140202:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd2b426c/0x419e1ae1f63434f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63434e9 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.140224:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd2b426c/0x419e1ae1f63434f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.140235:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd2b426c/0x419e1ae1f63434f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.140243:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd2b426c, rc 0) 00000100:00100000:3.0:1788586992.140281:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc27146e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844352:12345-0@lo:101: Request processed in 107us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586992.140288:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788586992.140478:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7eea589 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844352:0@lo:101: 00010000:00010000:0.0:1788586992.140494:0:7260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000001a6c6466/0x419e1ae1f63434e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.140504:0:7260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000001a6c6466/0x419e1ae1f63434e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586992.140595:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7eea589 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844480:0@lo:501: 00000100:00100000:0.0:1788586992.140619:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586992.140656:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077c6ec59 going to sleep for 11 seconds 00000100:00100000:3.0:1788586992.140755:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309844480 00000100:00100000:3.0:1788586992.140760:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309844480 00000100:00100000:3.0:1788586992.140790:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586992.140813:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009884ef03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844480:12345-0@lo:501: 00000100:00100000:3.0:1788586992.141068:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009884ef03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844480:12345-0@lo:501: Request processed in 255us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586992.141075:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586992.141107:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7eea589 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844480:0@lo:501: 00000100:00100000:3.0:1788586992.141143:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000432e6dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844608:0@lo:503: 00000100:00100000:3.0:1788586992.141180:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586992.141191:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 000000008de4769b going to sleep for 11 seconds 00000100:00100000:0.0:1788586992.141247:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309844608 00000100:00100000:0.0:1788586992.141252:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309844608 00000100:00100000:0.0:1788586992.141284:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788586992.141289:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000745f0ffb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844608:12345-0@lo:503: 00000100:00100000:0.0:1788586992.141561:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000745f0ffb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844608:12345-0@lo:503: Request processed in 271us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.141568:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788586992.141725:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000432e6dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844608:0@lo:503: 00000040:00080000:3.0:1788586992.142157:0:7260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788586992.142217:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000432e6dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844736:0@lo:502: 00000100:00100000:3.0:1788586992.142255:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586992.142289:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 000000008de4769b going to sleep for 11 seconds 00000100:00100000:0.0:1788586992.142780:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309844736 00000100:00100000:0.0:1788586992.142786:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309844736 00000100:00100000:0.0:1788586992.142844:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788586992.142852:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f40dd6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844736:12345-0@lo:502: 00000100:00100000:0.0:1788586992.143069:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f40dd6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844736:12345-0@lo:502: Request processed in 218us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.143076:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788586992.143232:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000432e6dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844736:0@lo:502: 00000040:00080000:3.0:1788586992.143703:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788586992.143787:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788586992.144038:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788586992.144092:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788586992.144130:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788586992.144197:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788586992.144237:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788586992.144273:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788586992.144404:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788586992.144456:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788586992.144493:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788586992.144541:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788586992.144577:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788586992.144626:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788586992.144968:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788586992.145009:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788586992.145043:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788586992.145084:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788586992.145112:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788586992.145136:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788586992.145183:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788586992.145209:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788586992.145234:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788586992.145269:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788586992.145296:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788586992.145466:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788586992.145505:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788586992.145532:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788586992.145570:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000432e6dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844864:0@lo:502: 00000100:00100000:3.0:1788586992.145699:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586992.145773:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 000000008de4769b going to sleep for 11 seconds 00000100:00100000:0.0:1788586992.147535:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309844864 00000100:00100000:0.0:1788586992.147546:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309844864 00000100:00100000:0.0:1788586992.147593:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788586992.147601:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a94cd9d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844864:12345-0@lo:502: 00000100:00100000:0.0:1788586992.147862:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a94cd9d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309844864:12345-0@lo:502: Request processed in 261us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.147870:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788586992.148132:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000432e6dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309844864:0@lo:502: 00000040:00080000:2.0:1788586992.148229:0:7260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788586992.148242:0:7260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788586992.153662:0:7276:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788586992.153680:0:7276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000967f47d2) 00000020:00000080:0.0:1788586992.153703:0:7276:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788586992.153844:0:7276:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008bd034b0 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788586992.153848:0:7276:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008bd034b0 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788586992.153851:0:7276:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008bd034b0 3 00010000:00080000:0.0:1788586992.153890:0:7276:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e33e10e4@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:0.0:1788586992.162296:0:7276:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1788586992.162530:0:7276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788586992.162568:0:7276:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788586992.162587:0:7276:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x419e1ae1f63434fe 00000100:00080000:0.0:1788586992.162598:0:7276:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788586992.162604:0:7276:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000e33e10e4 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788586992.162640:0:7276:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001ae00a58 x1875469309844992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788586992.162662:0:7276:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788586992.166143:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ae00a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469309844992:0@lo:38: 00000100:00100000:2.0:1788586992.166246:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:00080000:2.0:1788586992.168153:0:7277:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000040:00080000:0.0:1788586992.168198:0:7276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1788586992.172309:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309844992 00000100:00100000:2.0:1788586992.172327:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309844992 00000100:00100000:2.0:1788586992.172374:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586992.172383:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001db7376b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469309844992:12345-0@lo:38: 00010000:00080000:2.0:1788586992.172413:0:6473:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1788586992.172468:0:6473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x419e1ae1f6343505 00000004:00100000:2.0:1788586992.172485:0:6473:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788586992.172530:0:6473:0:(import.c:65:import_set_state_nolock()) 0000000098a60466 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788586992.172618:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001db7376b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1875469309844992:12345-0@lo:38: Request processed in 235us (6372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.172626:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1788586992.175142:0:7260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788586992.175189:0:7260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586992.175208:0:7260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000001a6c6466/0x419e1ae1f63434e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.175221:0:7260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000001a6c6466/0x419e1ae1f63434e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788586992.175255:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001ae00a58 x1875469309844992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586992.175274:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586992.175285:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788586992.175295:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788586992.175300:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788586992.175303:0:3471:0:(import.c:65:import_set_state_nolock()) 00000000e33e10e4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000020:01000004:3.0:1788586992.175306:0:7260:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788586992.175311:0:7260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000100:00100000:2.0:1788586992.175312:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ae00a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469309844992:0@lo:38: 00000020:01000004:3.0:1788586992.175313:0:7260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586992.175315:0:7260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586992.175316:0:7260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586992.175318:0:7260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586992.175319:0:7260:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586992.175323:0:7260:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586992.175325:0:7260:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586992.175328:0:7260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586992.175329:0:7260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788586992.175334:0:7260:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788586992.175336:0:7260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788586992.175338:0:7260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788586992.175339:0:7260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586992.175347:0:7260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586992.175349:0:7260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586992.175351:0:7260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586992.175351:0:7260:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586992.175352:0:7260:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586992.175353:0:7260:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586992.175355:0:7260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586992.175356:0:7260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788586992.175379:0:7260:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788586992.175394:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771d2aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309845120:0@lo:253: 00000100:00100000:3.0:1788586992.175468:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586992.175507:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2aed8d6 going to sleep for 11 seconds 00000100:00100000:2.0:1788586992.176574:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309845120 00000100:00100000:2.0:1788586992.176585:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309845120 00000100:00100000:2.0:1788586992.176632:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788586992.176640:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d7a22cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:7260:x1875469309845120:12345-0@lo:253: 20000000:01000000:2.0:1788586992.176681:0:6467:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788586992.176696:0:6467:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1788586992.193074:0:6477:0:(import.c:65:import_set_state_nolock()) 000000008639d12b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586992.193167:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b2549e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469309843456:12345-0@lo:38: Request processed in 68307us (71398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586992.193178:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586992.193233:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788586992.193243:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788586992.193252:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788586992.193257:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788586992.193260:0:3471:0:(import.c:65:import_set_state_nolock()) 00000000d5e4d765 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788586992.193272:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001191f59c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469309843456:0@lo:38: 00000100:00100000:3.0:1788586992.193356:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000253cf710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309845248:0@lo:41: 00000100:00100000:3.0:1788586992.193392:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.193461:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309845248 00000100:00100000:1.0:1788586992.193469:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309845248 00000100:00100000:1.0:1788586992.193516:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586992.193525:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f248ecb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3474:x1875469309845248:12345-0@lo:41: 00000004:00000024:1.0:1788586992.193553:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788586992.193645:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f248ecb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3474:x1875469309845248:12345-0@lo:41: Request processed in 123us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.193652:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586992.193830:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000253cf710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309845248:0@lo:41: 20000000:01000000:2.0:1788586992.234773:0:6467:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788586992.234929:0:6488:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788586992.234935:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788586992.234954:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.234972:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 15 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.234990:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.234997:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.235036:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.235048:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 15 pid: 6467 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586992.235061:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000253cf710 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309845376:0@lo:104: 00000100:00100000:3.0:1788586992.235133:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586992.235184:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 15 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.235192:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 15 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586992.235199:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7d71a81 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309845504:0@lo:104: 00000100:00100000:3.0:1788586992.235216:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586992.235232:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073938046 going to sleep for 11 seconds 00000100:00100000:0.0:1788586992.235295:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309845376 00000100:00100000:0.0:1788586992.235303:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309845376 00000100:00100000:0.0:1788586992.235339:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309845504 00000100:00100000:0.0:1788586992.235341:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309845504 00000100:00100000:0.0:1788586992.235352:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586992.235358:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a22853d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:6488:x1875469309845376:12345-0@lo:104: 00010000:00010000:0.0:1788586992.235369:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.235431:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586992.235436:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a22853d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:6488:x1875469309845376:12345-0@lo:104: Request processed in 80us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.235443:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586992.235458:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586992.235462:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc3ff67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6488:x1875469309845504:12345-0@lo:104: 00010000:00010000:0.0:1788586992.235468:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.235494:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788586992.235498:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc3ff67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6488:x1875469309845504:12345-0@lo:104: Request processed in 36us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.235513:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:2.0:1788586992.235572:0:6467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788586992.235835:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000253cf710 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309845376:0@lo:104: 00000100:00100000:3.0:1788586992.235843:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7d71a81 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309845504:0@lo:104: 00010000:00010000:3.0:1788586992.235862:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.239528:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788586992.239539:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.239551:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000006b95312 already unused, calling callback (000000009a9b2dd3) 10000000:00010000:3.0:1788586992.239555:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.239563:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586992.239570:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586992.239576:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586992.239666:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.239673:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586992.239689:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.239706:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 0000000006b95312/0x419e1ae1f63434c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434cd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.239721:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586992.239723:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.239741:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006db4e21a already unused, calling callback (000000009a9b2dd3) 10000000:00010000:3.0:1788586992.239743:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.239749:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586992.239756:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586992.239760:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788586992.243342:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788586992.243442:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7d71a81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309845632:0@lo:103: 00000100:00100000:1.0:1788586992.243523:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788586992.243585:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586992.243601:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309845632 00000100:00100000:1.0:1788586992.243609:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309845632 00010000:00010000:1.0:1788586992.243774:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 16 pid: 6467 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586992.243828:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586992.243838:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea08e9ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+16:3474:x1875469309845632:12345-0@lo:103: 00010000:00010000:1.0:1788586992.243852:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586992.243857:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 16 pid: 6467 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.243868:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 16 pid: 6467 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.244263:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc48c4b3/0x419e1ae1f63434cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63434c6 expref: 16 pid: 6467 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586992.244279:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586992.244321:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea08e9ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+15:3474:x1875469309845632:12345-0@lo:103: Request processed in 486us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.244329:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586992.244377:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7d71a81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309845632:0@lo:103: 00010000:00010000:3.0:1788586992.245010:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.245022:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586992.245035:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.245042:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 000000006db4e21a/0x419e1ae1f6343425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634342c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.245058:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586992.245060:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586992.245062:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586992.245381:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000253cf710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309845760:0@lo:103: 00000100:00100000:1.0:1788586992.245443:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.245723:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309845760 00000100:00100000:2.0:1788586992.245730:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309845760 00010000:00010000:2.0:1788586992.245754:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 15 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586992.245786:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788586992.245818:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005446f79b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+15:3472:x1875469309845760:12345-0@lo:103: 00010000:00010000:2.0:1788586992.245830:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586992.245835:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 15 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.245844:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 15 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.245855:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cf22833c/0x419e1ae1f634342c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343425 expref: 15 pid: 6465 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.245867:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.246069:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788586992.246095:0:6458:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011161888s 00010000:00010000:2.0:1788586992.246099:0:6458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.246106:0:6458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.246111:0:6458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.246117:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.246122:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b76927d3 already unused, calling callback (00000000158838a5) 00010000:00010000:2.0:1788586992.246125:0:6458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.246131:0:6458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.246149:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586992.246159:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586992.246204:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005446f79b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+14:3472:x1875469309845760:12345-0@lo:103: Request processed in 411us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.246211:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586992.246307:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000253cf710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309845760:0@lo:103: 00010000:00010000:3.0:1788586992.246354:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.246362:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.246380:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b76927d3/0x419e1ae1f634350c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788586992.274617:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788586992.280307:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d7a22cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+13:7260:x1875469309845120:12345-0@lo:253: Request processed in 103659us (104830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.280323:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788586992.280451:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771d2aee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:7260:1875469309845120:0@lo:253: 10000000:01000000:3.0:1788586992.280466:0:7260:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788586992.280469:0:7260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788586992.280471:0:7260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788586992.280472:0:7260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586992.280473:0:7260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586992.280474:0:7260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586992.280475:0:7260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586992.280476:0:7260:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586992.280478:0:7260:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586992.280479:0:7260:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586992.280480:0:7260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586992.280482:0:7260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788586992.280496:0:7260:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788586992.286483:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586992.287203:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586992.287446:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586992.287617:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586992.288122:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586992.288296:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586992.289451:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586992.289855:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586992.290147:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586992.290334:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586992.290569:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586992.291606:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:1.0:1788586992.294234:0:7260:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1788586992.294522:0:7283:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1788586992.294575:0:7283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000560ab6c5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7283:1875469309845888:0@lo:700: 00000100:00100000:1.0:1788586992.294651:0:7283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1788586992.294827:0:7260:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788586992.295025:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309845888 00000100:00100000:1.0:1788586992.295032:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309845888 00000100:00100000:1.0:1788586992.295068:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586992.295076:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fbc6bb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7283:x1875469309845888:12345-0@lo:700: 00000020:00080000:3.0:1788586992.295962:0:7282:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788586992.295968:0:7282:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788586992.296169:0:7284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771d2aee pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846016:0@lo:1000: 00000100:00100000:3.0:1788586992.296227:0:7284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586992.296263:0:7284:0:(client.c:2716:ptlrpc_set_wait()) set 000000005eddff30 going to sleep for 11 seconds 00000040:01000000:0.0:1788586992.297214:0:7260:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788586992.297363:0:7260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788586992.297859:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309846016 00000100:00100000:1.0:1788586992.297868:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309846016 00000100:00100000:1.0:1788586992.298043:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788586992.298053:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb842063 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846016:12345-0@lo:1000: 00000100:00100000:1.0:1788586992.298165:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb842063 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846016:12345-0@lo:1000: Request processed in 114us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.298173:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788586992.298304:0:7283:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d14a5525 going to sleep for 11 seconds 00000100:00100000:1.0:1788586992.298343:0:7284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771d2aee pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846016:0@lo:1000: 00000040:01000000:1.0:1788586992.298380:0:7284:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788586992.298428:0:7284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846144:0@lo:700: 00000100:00100000:1.0:1788586992.298461:0:7284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.298502:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309846144 00000100:00100000:1.0:1788586992.298506:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309846144 00000100:00100000:1.0:1788586992.298532:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586992.298537:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001191f59c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846144:12345-0@lo:700: 00000100:00100000:1.0:1788586992.298573:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001191f59c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846144:12345-0@lo:700: Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.298579:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586992.298596:0:7284:0:(client.c:2716:ptlrpc_set_wait()) set 00000000530148a9 going to sleep for 11 seconds 00000100:00100000:1.0:1788586992.298617:0:7284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846144:0@lo:700: 00000100:00100000:1.0:1788586992.301521:0:7284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7284:1875469309846272:0@lo:900: 00000100:00100000:1.0:1788586992.301586:0:7284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.301620:0:7284:0:(client.c:2716:ptlrpc_set_wait()) set 00000000530148a9 going to sleep for 11 seconds 00000004:00000080:0.0:1788586992.301770:0:7260:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788586992.301813:0:7260:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1788586992.302033:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309846272 00000100:00100000:2.0:1788586992.302040:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309846272 00000040:00080000:0.0:1788586992.302312:0:7260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586992.303491:0:7260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788586992.304864:0:7260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788586992.304982:0:7260:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788586992.305246:0:7260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788586992.305467:0:7260:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000100:00100000:2.0:1788586992.305927:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586992.305942:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce90444b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7284:x1875469309846272:12345-0@lo:900: 00100000:10000000:0.0:1788586992.307159:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788586992.307309:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788586992.307458:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788586992.307604:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788586992.307992:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788586992.308147:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788586992.308363:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788586992.308518:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788586992.309179:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788586992.309346:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788586992.309484:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788586992.309635:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:2.0:1788586992.309740:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce90444b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7284:x1875469309846272:12345-0@lo:900: Request processed in 3800us (8150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.309752:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:0.0:1788586992.310182:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788586992.310341:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788586992.310514:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788586992.310667:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788586992.311162:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788586992.311311:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788586992.311458:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788586992.311602:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00010000:00080000:2.0:1788586992.311970:0:7284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ea08e9ef x1875469309846272/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587008 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586992.311986:0:7284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea08e9ef pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7284:1875469309846272:0@lo:900: 00000100:00100000:2.0:1788586992.312111:0:7284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a6892d7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846400:0@lo:1000: 00000100:00100000:2.0:1788586992.312172:0:7284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.312200:0:7284:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7b30d49 going to sleep for 11 seconds 00100000:10000000:0.0:1788586992.312409:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788586992.312564:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788586992.313106:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788586992.313254:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788586992.313410:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788586992.313584:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788586992.314045:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788586992.314223:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788586992.314390:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788586992.314645:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788586992.314838:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788586992.315185:0:7260:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788586992.315385:0:7260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788586992.316111:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309846400 00000100:00100000:1.0:1788586992.316121:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309846400 00000100:00100000:1.0:1788586992.316160:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788586992.316167:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f86ecb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846400:12345-0@lo:1000: 00000100:00100000:1.0:1788586992.316275:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f86ecb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846400:12345-0@lo:1000: Request processed in 108us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.316282:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788586992.316340:0:7284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a6892d7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846400:0@lo:1000: 00000004:00080000:1.0:1788586992.316396:0:7284:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c8717ad1 with version 0 00000020:00100000:1.0:1788586992.316428:0:7284:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788586992.316434:0:7284:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004212ee9f x1875469309846656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788586992.316453:0:7284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004212ee9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846656:0@lo:1000: 00000100:00100000:1.0:1788586992.316486:0:7284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.316508:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309846656 00000100:00100000:1.0:1788586992.316512:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309846656 00000100:00100000:1.0:1788586992.316531:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586992.316535:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010f3adf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846656:12345-0@lo:1000: 00000100:00100000:1.0:1788586992.318621:0:7284:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293ce041 going to sleep for 11 seconds 40000000:02000000:0.0:1788586992.389858:0:6479:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1788586992.398096:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fbc6bb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7283:x1875469309845888:12345-0@lo:700: Request processed in 103013us (103437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.398118:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788586992.399608:0:7283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000560ab6c5 x1875469309845888/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788587008 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586992.399694:0:7283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000560ab6c5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7283:1875469309845888:0@lo:700: 40000000:02000000:1.0:1788586992.399718:0:7283:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1788586992.437721:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1788586992.439147:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010f3adf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846656:12345-0@lo:1000: Request processed in 122603us (122652us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788586992.439174:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788586992.439270:0:7284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788586992.439275:0:7284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788586992.439291:0:7284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004212ee9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846656:0@lo:1000: 00000100:00100000:1.0:1788586992.439369:0:7284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004212ee9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846784:0@lo:1000: 00000100:00100000:1.0:1788586992.439403:0:7284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.439462:0:7284:0:(client.c:2716:ptlrpc_set_wait()) set 000000004502fc7d going to sleep for 11 seconds 00000100:00100000:2.0:1788586992.439514:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309846784 00000100:00100000:2.0:1788586992.439520:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309846784 00000100:00100000:2.0:1788586992.439554:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788586992.439562:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000560ab6c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846784:12345-0@lo:1000: 00000100:00100000:2.0:1788586992.439644:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000560ab6c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7284:x1875469309846784:12345-0@lo:1000: Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.439651:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586992.439770:0:7284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004212ee9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7284:1875469309846784:0@lo:1000: 00000040:00080000:1.0:1788586992.439786:0:7284:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788586992.439828:0:7284:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000085869baf with version 1 00000004:00080000:2.0:1788586992.440872:0:7273:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003d067624 version 1 rpc_version 1 00000020:00100000:2.0:1788586992.440906:0:7273:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788586992.440913:0:7273:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000dcc66b0c x1875469309847040/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788586992.440929:0:7273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcc66b0c pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7273:1875469309847040:0@lo:1000: 00000100:00100000:2.0:1788586992.440970:0:7273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.440999:0:7273:0:(client.c:2716:ptlrpc_set_wait()) set 000000001138059d going to sleep for 11 seconds 00000100:00100000:3.0:1788586992.441927:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309847040 00000100:00100000:3.0:1788586992.441938:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309847040 00000100:00100000:3.0:1788586992.441990:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586992.441998:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb3431dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7273:x1875469309847040:12345-0@lo:1000: 00000040:00080000:1.0:1788586992.445671:0:7284:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788586992.445747:0:7284:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1788586992.452742:0:7260:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788586992.452776:0:7260:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb62541c1b988 00100000:10000000:1.0:1788586992.452784:0:7260:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788586992.463565:0:7260:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788586992.463609:0:7260:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788586992.463621:0:7260:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788586992.463654:0:7260:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000100:00100000:3.0:1788586992.503133:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb3431dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7273:x1875469309847040:12345-0@lo:1000: Request processed in 61127us (62154us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788586992.503162:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1788586992.503218:0:7273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788586992.503236:0:7273:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788586992.503253:0:7273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcc66b0c pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7273:1875469309847040:0@lo:1000: 00000001:00080000:1.0:1788586992.503504:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000040:00080000:3.0:1788586992.583286:0:7283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788586992.648258:0:7283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788586992.648342:0:7283:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788586992.648347:0:7283:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788586993.068386:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586994.090990:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586995.114979:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586996.138973:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586996.511777:0:7527:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788586997.165324:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586997.291228:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021deb923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309847296:0@lo:400: 00000100:00100000:2.0:1788586997.291345:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033bd25e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309847552:0@lo:400: 00000100:00100000:0.0:1788586997.291394:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000db95e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309847168:0@lo:400: 00000100:00100000:1.0:1788586997.293048:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0bc8783 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309847424:0@lo:400: 00000100:00100000:2.0:1788586997.293278:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.293356:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586997.293363:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004212ee9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309847680:0@lo:41: 00000100:00100000:2.0:1788586997.293403:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.295757:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.295897:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309847552 00000100:00100000:0.0:1788586997.295909:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309847552 00000100:00100000:0.0:1788586997.295969:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788586997.295979:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb9a5c6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309847552:12345-0@lo:400: 00000100:00100000:0.0:1788586997.296061:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb9a5c6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309847552:12345-0@lo:400: Request processed in 84us (2786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.296069:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788586997.296094:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309847168 00000100:00100000:0.0:1788586997.296097:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309847168 00000100:00100000:0.0:1788586997.296120:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788586997.296125:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3fce188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+13:3473:x1875469309847168:12345-0@lo:400: 00000100:00100000:0.0:1788586997.296153:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3fce188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+13:3473:x1875469309847168:12345-0@lo:400: Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.296159:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788586997.296208:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000033bd25e6 x1875469309847552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586997.296224:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033bd25e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309847552:0@lo:400: 00000100:00100000:0.0:1788586997.296248:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000db95e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309847168:0@lo:400: 00000100:00100000:3.0:1788586997.298592:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586997.298686:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309847680 00000100:00100000:3.0:1788586997.298695:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309847680 00000100:00100000:3.0:1788586997.298753:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586997.298762:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd0ca257 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309847680:12345-0@lo:41: 00000004:00000024:3.0:1788586997.298947:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788586997.299029:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd0ca257 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309847680:12345-0@lo:41: Request processed in 268us (5625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.299036:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586997.299096:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004212ee9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309847680:0@lo:41: 00000100:00100000:2.0:1788586997.299397:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309847296 00000100:00100000:2.0:1788586997.299403:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309847296 00000100:00100000:2.0:1788586997.299444:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586997.299451:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000db95e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309847296:12345-0@lo:400: 00000100:00100000:2.0:1788586997.299494:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000db95e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309847296:12345-0@lo:400: Request processed in 44us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.299516:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788586997.299679:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000021deb923 x1875469309847296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586997.299691:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021deb923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309847296:0@lo:400: 00000100:00100000:1.0:1788586997.299790:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586997.304698:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309847424 00000100:00100000:3.0:1788586997.304719:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309847424 00000100:00100000:2.0:1788586997.313970:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586997.313988:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095428f50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309847424:12345-0@lo:400: 00000100:00100000:2.0:1788586997.314124:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095428f50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309847424:12345-0@lo:400: Request processed in 139us (14333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.314132:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586997.314191:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0bc8783 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309847424:0@lo:400: 10000000:01000000:2.0:1788586997.808513:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788586997.808524:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf04818800 from 4 10000000:01000000:2.0:1788586997.808531:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788586997.808598:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000bbc9d7ce/0x419e1ae1f6343513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.808615:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000bbc9d7ce/0x419e1ae1f6343513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.808628:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000bbc9d7ce/0x419e1ae1f6343513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.808661:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fb655b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309847808:0@lo:101: 00000100:00100000:2.0:1788586997.808758:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.808849:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a121c9d0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.808880:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309847808 00000100:00100000:2.0:1788586997.808890:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309847808 00000100:00100000:2.0:1788586997.808967:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788586997.808977:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036e84a43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+13:6469:x1875469309847808:12345-0@lo:101: 00010000:00010000:2.0:1788586997.808996:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586997.809018:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bbbbd2c/0x419e1ae1f634351a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343513 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.809048:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bbbbd2c/0x419e1ae1f634351a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 14 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.809061:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bbbbd2c/0x419e1ae1f634351a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 14 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.809071:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bbbbd2c, rc 0) 00000100:00100000:2.0:1788586997.809116:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036e84a43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+14:6469:x1875469309847808:12345-0@lo:101: Request processed in 141us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.809123:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788586997.809181:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fb655b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309847808:0@lo:101: 00010000:00010000:2.0:1788586997.809199:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000bbc9d7ce/0x419e1ae1f6343513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.809209:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000bbc9d7ce/0x419e1ae1f6343513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.809265:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fb655b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309847936:0@lo:256: 00000100:00100000:2.0:1788586997.809300:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.809331:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a121c9d0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.809505:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309847936 00000100:00100000:1.0:1788586997.809520:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309847936 00000100:00100000:1.0:1788586997.809561:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788586997.809569:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f389a409 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:6469:x1875469309847936:12345-0@lo:256: 20000000:01000000:1.0:1788586997.809591:0:6464:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788586997.809620:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788586997.809625:0:6464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788586997.809735:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f389a409 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:6469:x1875469309847936:12345-0@lo:256: Request processed in 166us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.809743:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788586997.809921:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fb655b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309847936:0@lo:256: 10000000:01000000:0.0:1788586997.809972:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788586997.809979:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000bbc9d7ce/0x419e1ae1f6343513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.809989:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000bbc9d7ce/0x419e1ae1f6343513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586997.810000:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788586997.810008:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf11802800 from 21 10000000:01000000:0.0:1788586997.810012:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788586997.810084:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000009b4603b9/0x419e1ae1f6343521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.810093:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000009b4603b9/0x419e1ae1f6343521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.810101:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000009b4603b9/0x419e1ae1f6343521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.810115:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf18dc6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848064:0@lo:101: 00000100:00100000:0.0:1788586997.810157:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.810189:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000862f68ca going to sleep for 11 seconds 00000100:00100000:0.0:1788586997.810263:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309848064 00000100:00100000:0.0:1788586997.810269:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309848064 00000100:00100000:0.0:1788586997.810296:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788586997.810302:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003af8bda0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:6469:x1875469309848064:12345-0@lo:101: 00010000:00010000:0.0:1788586997.810311:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586997.810322:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c6bb2d6/0x419e1ae1f6343528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343521 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.810342:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c6bb2d6/0x419e1ae1f6343528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 15 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.810352:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c6bb2d6/0x419e1ae1f6343528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 15 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.810360:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c6bb2d6, rc 0) 00000100:00100000:0.0:1788586997.810402:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003af8bda0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309848064:12345-0@lo:101: Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.810415:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788586997.810450:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf18dc6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848064:0@lo:101: 00010000:00010000:0.0:1788586997.810463:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000009b4603b9/0x419e1ae1f6343521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.810471:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000009b4603b9/0x419e1ae1f6343521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.810524:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf18dc6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848192:0@lo:501: 00000100:00100000:0.0:1788586997.810549:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.810576:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000862f68ca going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.810674:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309848192 00000100:00100000:2.0:1788586997.810679:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309848192 00000100:00100000:2.0:1788586997.810701:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788586997.810707:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005388d375 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309848192:12345-0@lo:501: 00000100:00100000:2.0:1788586997.811100:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005388d375 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309848192:12345-0@lo:501: Request processed in 392us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.811119:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788586997.811159:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf18dc6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848192:0@lo:501: 00000100:00100000:2.0:1788586997.811191:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b010b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848320:0@lo:503: 00000100:00100000:2.0:1788586997.811232:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.811258:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a121c9d0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.811271:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309848320 00000100:00100000:2.0:1788586997.811275:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309848320 00000100:00100000:2.0:1788586997.811294:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788586997.811300:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e84508f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309848320:12345-0@lo:503: 00000100:00100000:2.0:1788586997.811608:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e84508f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309848320:12345-0@lo:503: Request processed in 308us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.811615:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788586997.811655:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b010b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848320:0@lo:503: 00000100:00100000:1.0:1788586997.817727:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7603:1875469309848448:0@lo:502: 00000100:00100000:1.0:1788586997.817891:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.818019:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309848448 00000100:00100000:2.0:1788586997.818029:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309848448 00000100:00100000:2.0:1788586997.818096:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788586997.818107:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a6f02c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:7603:x1875469309848448:12345-0@lo:502: 00000100:00100000:2.0:1788586997.818538:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a6f02c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:7603:x1875469309848448:12345-0@lo:502: Request processed in 432us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.818549:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788586997.818677:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0ed5f0e going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.818717:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7603:1875469309848448:0@lo:502: 00000100:00100000:1.0:1788586997.818784:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7603:1875469309848576:0@lo:502: 00000100:00100000:1.0:1788586997.818854:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586997.818888:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309848576 00000100:00100000:1.0:1788586997.818893:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309848576 00000100:00100000:1.0:1788586997.819684:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788586997.819699:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e23fe14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:7603:x1875469309848576:12345-0@lo:502: 00000100:00100000:1.0:1788586997.819961:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e23fe14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:7603:x1875469309848576:12345-0@lo:502: Request processed in 265us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.819967:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788586997.820584:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0ed5f0e going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.820839:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7603:1875469309848576:0@lo:502: 00000040:00080000:1.0:1788586997.820881:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788586997.821114:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788586997.821137:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788586997.821149:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000009b4603b9/0x419e1ae1f6343521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.821162:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000009b4603b9/0x419e1ae1f6343521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586997.821186:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788586997.821189:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf11802800 from 4 10000000:01000000:2.0:1788586997.821193:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788586997.821292:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634352f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.821301:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634352f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.821310:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634352f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.821333:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b010b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848704:0@lo:101: 00000100:00100000:2.0:1788586997.821403:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.821480:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053e296b0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586997.821522:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309848704 00000100:00100000:0.0:1788586997.821529:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309848704 00000100:00100000:0.0:1788586997.821581:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788586997.821589:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe0a5c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309848704:12345-0@lo:101: 00010000:00010000:0.0:1788586997.821610:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586997.821624:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000936e936c/0x419e1ae1f6343536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634352f expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.821652:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000936e936c/0x419e1ae1f6343536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634352f expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.821663:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000936e936c/0x419e1ae1f6343536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634352f expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.821672:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000936e936c, rc 0) 00000100:00100000:0.0:1788586997.821711:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe0a5c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309848704:12345-0@lo:101: Request processed in 123us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.821728:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788586997.821951:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b010b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848704:0@lo:101: 00010000:00010000:2.0:1788586997.821968:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634352f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.821978:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634352f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.822032:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b010b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848832:0@lo:256: 00000100:00100000:2.0:1788586997.822067:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.822127:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053e296b0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586997.822159:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309848832 00000100:00100000:0.0:1788586997.822165:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309848832 00000100:00100000:0.0:1788586997.822293:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788586997.822302:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037782927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309848832:12345-0@lo:256: 20000000:01000000:0.0:1788586997.822318:0:6464:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788586997.822338:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788586997.822342:0:6464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788586997.822445:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037782927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309848832:12345-0@lo:256: Request processed in 145us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.822454:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788586997.822513:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b010b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848832:0@lo:256: 10000000:01000000:2.0:1788586997.822568:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788586997.822580:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634352f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.822588:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000a26a8be8/0x419e1ae1f634352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586997.822606:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788586997.822608:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788586997.822611:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788586997.822631:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000680e0a2e/0x419e1ae1f634353d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.822638:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000680e0a2e/0x419e1ae1f634353d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.822646:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000680e0a2e/0x419e1ae1f634353d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.822658:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b010b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848960:0@lo:101: 00000100:00100000:2.0:1788586997.822687:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.822835:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053e296b0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.822883:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309848960 00000100:00100000:1.0:1788586997.822896:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309848960 00000100:00100000:1.0:1788586997.822927:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788586997.822934:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea28ccfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309848960:12345-0@lo:101: 00010000:00010000:1.0:1788586997.822942:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586997.822954:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0eb93aa/0x419e1ae1f6343544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634353d expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.822972:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0eb93aa/0x419e1ae1f6343544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634353d expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.822982:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0eb93aa/0x419e1ae1f6343544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634353d expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.822991:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0eb93aa, rc 0) 00000100:00100000:1.0:1788586997.823033:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea28ccfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309848960:12345-0@lo:101: Request processed in 100us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.823039:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788586997.823075:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b010b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309848960:0@lo:101: 00010000:00010000:3.0:1788586997.823089:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000680e0a2e/0x419e1ae1f634353d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.823103:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000680e0a2e/0x419e1ae1f634353d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586997.823154:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021deb923 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309849088:0@lo:501: 00000100:00100000:3.0:1788586997.823295:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586997.823315:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 000000008de4769b going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.823392:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309849088 00000100:00100000:1.0:1788586997.823398:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309849088 00000100:00100000:1.0:1788586997.823458:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788586997.823465:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b231dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309849088:12345-0@lo:501: 00000100:00100000:1.0:1788586997.824350:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b231dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309849088:12345-0@lo:501: Request processed in 882us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.824361:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788586997.824731:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021deb923 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309849088:0@lo:501: 00000100:00100000:1.0:1788586997.824784:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309849216:0@lo:503: 00000100:00100000:1.0:1788586997.825124:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586997.825182:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2073a12 going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.825278:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309849216 00000100:00100000:2.0:1788586997.825286:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309849216 00000100:00100000:2.0:1788586997.825364:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788586997.825373:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004db67320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309849216:12345-0@lo:503: 00000100:00100000:2.0:1788586997.826141:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004db67320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309849216:12345-0@lo:503: Request processed in 765us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.826151:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788586997.826365:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309849216:0@lo:503: 00000100:00100000:2.0:1788586997.827091:0:7605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1d289b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7605:1875469309849344:0@lo:502: 00000100:00100000:2.0:1788586997.827168:0:7605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.827529:0:7605:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a613505 going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.828000:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309849344 00000100:00100000:1.0:1788586997.828009:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309849344 00000100:00100000:1.0:1788586997.828087:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788586997.828094:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016d050c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:7605:x1875469309849344:12345-0@lo:502: 00000100:00100000:1.0:1788586997.828402:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016d050c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:7605:x1875469309849344:12345-0@lo:502: Request processed in 308us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.828410:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788586997.828531:0:7605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1d289b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7605:1875469309849344:0@lo:502: 00000020:01000000:2.0:1788586997.828569:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586997.828583:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586997.828586:0:7605:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788586997.828591:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788586997.828661:0:7605:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:00000080:2.0:1788586997.828694:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788586997.828713:0:7605:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000b3f2bc40) 00000020:00000080:2.0:1788586997.828753:0:7605:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788586997.828763:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788586997.828924:0:7605:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788586997.828930:0:7605:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788586997.828937:0:7605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6343552 00010000:00080000:2.0:1788586997.828976:0:7605:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d41e9d4b@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788586997.833141:0:7605:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788586997.835346:0:7605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788586997.835368:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788586997.835425:0:7605:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788586997.835461:0:7605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6343559 00000100:00080000:2.0:1788586997.835477:0:7605:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788586997.835485:0:7605:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d41e9d4b using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788586997.835535:0:7605:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a1d289b6 x1875469309849472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788586997.835566:0:7605:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788586997.835718:0:7605:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788586997.835832:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1d289b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309849472:0@lo:38: 00000100:00100000:3.0:1788586997.836427:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788586997.838477:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586997.838492:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586997.838495:0:7605:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788586997.838500:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586997.838506:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586997.838508:0:7605:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788586997.838511:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586997.838513:0:7605:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788586997.838575:0:7605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7605:1875469309849600:0@lo:502: 00000100:00100000:0.0:1788586997.838691:0:7605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.838743:0:7605:0:(client.c:2716:ptlrpc_set_wait()) set 0000000098c38ff5 going to sleep for 11 seconds 00000100:00080000:0.0:1788586997.838867:0:7608:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000056a75d6f x1875469309849728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586997.838877:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f219c8e3 going to sleep for 0 seconds 00000100:00100000:0.0:1788586997.840429:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309849600 00000100:00100000:0.0:1788586997.840448:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309849600 00000100:00100000:0.0:1788586997.840555:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788586997.840566:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000484944fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:7605:x1875469309849600:12345-0@lo:502: 00000100:00100000:0.0:1788586997.841004:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000484944fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:7605:x1875469309849600:12345-0@lo:502: Request processed in 438us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.841015:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788586997.841132:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309849472 00000100:00100000:2.0:1788586997.841140:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309849472 00000100:00100000:2.0:1788586997.841191:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586997.841197:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033bd25e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469309849472:12345-0@lo:38: 00010000:00080000:2.0:1788586997.841226:0:6477:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:2.0:1788586997.841269:0:6477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6343560 00000004:00100000:2.0:1788586997.841290:0:6477:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788586997.841298:0:6477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788586997.842296:0:7605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7605:1875469309849600:0@lo:502: 00000020:01000000:0.0:1788586997.842351:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586997.842362:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586997.842365:0:7605:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788586997.842369:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788586997.843056:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788586997.843088:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788586997.843102:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000680e0a2e/0x419e1ae1f634353d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.843116:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000680e0a2e/0x419e1ae1f634353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586997.843129:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788586997.843132:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbf053a99c0 from 1 10000000:01000000:1.0:1788586997.843135:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788586997.843177:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000e400ca2a/0x419e1ae1f6343567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.843185:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000e400ca2a/0x419e1ae1f6343567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.843194:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000e400ca2a/0x419e1ae1f6343567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586997.843683:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309849856:0@lo:101: 00000100:00100000:1.0:1788586997.843780:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586997.843850:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db12fdab going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.843876:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309849856 00000100:00100000:1.0:1788586997.843884:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309849856 00000100:00100000:1.0:1788586997.843933:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788586997.843941:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6ea76a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309849856:12345-0@lo:101: 00010000:00010000:1.0:1788586997.843957:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586997.843972:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085810448/0x419e1ae1f634356e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343567 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.844001:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085810448/0x419e1ae1f634356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.844014:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085810448/0x419e1ae1f634356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.844024:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085810448, rc 0) 00000100:00100000:1.0:1788586997.844065:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6ea76a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309849856:12345-0@lo:101: Request processed in 124us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.844073:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788586997.844125:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309849856:0@lo:101: 00010000:00010000:1.0:1788586997.844141:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000e400ca2a/0x419e1ae1f6343567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.844151:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000e400ca2a/0x419e1ae1f6343567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586997.844205:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309849984:0@lo:501: 00000100:00100000:1.0:1788586997.844703:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586997.844742:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db12fdab going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.844760:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309849984 00000100:00100000:1.0:1788586997.844766:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309849984 00000100:00100000:1.0:1788586997.844834:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788586997.844843:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000260d197f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309849984:12345-0@lo:501: 00000100:00100000:1.0:1788586997.845133:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000260d197f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309849984:12345-0@lo:501: Request processed in 291us (430us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788586997.845142:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788586997.845700:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309849984:0@lo:501: 10000000:01000000:1.0:1788586997.845749:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788586997.845761:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000e400ca2a/0x419e1ae1f6343567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.845772:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000e400ca2a/0x419e1ae1f6343567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788586997.901448:0:6477:0:(import.c:65:import_set_state_nolock()) 00000000b4bc1c16 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788586997.901573:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033bd25e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469309849472:12345-0@lo:38: Request processed in 60372us (65146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.901587:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586997.901683:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586997.901694:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788586997.901704:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788586997.901711:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788586997.901714:0:3471:0:(import.c:65:import_set_state_nolock()) 00000000d41e9d4b lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788586997.901727:0:3471:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f219c8e3): req@0000000056a75d6f x1875469309849728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586997.901745:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1d289b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309849472:0@lo:38: 00000100:00100000:2.0:1788586997.901841:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1d289b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309850112:0@lo:41: 00000100:00100000:2.0:1788586997.901881:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.901931:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309850112 00000100:00100000:2.0:1788586997.901937:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309850112 00000100:00100000:2.0:1788586997.901973:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586997.901980:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020ce6dac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469309850112:12345-0@lo:41: 00000004:00000024:2.0:1788586997.902019:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788586997.902051:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020ce6dac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469309850112:12345-0@lo:41: Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.902063:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586997.902091:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1d289b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309850112:0@lo:41: 00000100:00100000:2.0:1788586997.902134:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.902149:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309849728 00000100:00100000:2.0:1788586997.902152:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309849728 00000100:00100000:2.0:1788586997.902166:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586997.902171:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1d289b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309849728:12345-0@lo:1000: 00000100:00100000:2.0:1788586997.902228:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1d289b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309849728:12345-0@lo:1000: Request processed in 58us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.902234:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586997.902253:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056a75d6f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309849728:0@lo:1000: 00000040:01000000:2.0:1788586997.902286:0:7608:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788586997.902318:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6028baa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850240:0@lo:1000: 00000100:00100000:2.0:1788586997.902342:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.902642:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309850240 00000100:00100000:2.0:1788586997.902647:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309850240 00000100:00100000:2.0:1788586997.902713:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788586997.902720:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bba7638a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850240:12345-0@lo:1000: 00000100:00100000:2.0:1788586997.902973:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bba7638a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850240:12345-0@lo:1000: Request processed in 253us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.902980:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586997.903052:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set 000000009daf9d93 going to sleep for 11 seconds 00000100:00100000:0.0:1788586997.903077:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6028baa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850240:0@lo:1000: 00000100:00100000:0.0:1788586997.903129:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850368:0@lo:700: 00000100:00100000:0.0:1788586997.903162:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.903187:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cdbd2c2a going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.903193:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309850368 00000100:00100000:1.0:1788586997.903199:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309850368 00000100:00100000:1.0:1788586997.903244:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586997.903251:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a43031 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850368:12345-0@lo:700: 00000100:00100000:1.0:1788586997.903308:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a43031 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850368:12345-0@lo:700: Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.903315:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586997.903335:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850368:0@lo:700: 00000100:00100000:0.0:1788586997.903552:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850496:0@lo:1000: 00000100:00100000:0.0:1788586997.903582:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.903637:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018ee33a6 going to sleep for 11 seconds 00000100:00100000:3.0:1788586997.903715:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309850496 00000100:00100000:3.0:1788586997.903721:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309850496 00000100:00100000:3.0:1788586997.903787:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788586997.903822:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003de61861 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850496:12345-0@lo:1000: 00000100:00100000:3.0:1788586997.903899:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003de61861 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850496:12345-0@lo:1000: Request processed in 106us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.903906:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586997.903969:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850496:0@lo:1000: 00000004:00080000:0.0:1788586997.904016:0:7608:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000cdbd2c2a with version 0 00000020:00100000:0.0:1788586997.904034:0:7608:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788586997.904040:0:7608:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000050dbf767 x1875469309850752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788586997.904055:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850752:0@lo:1000: 00000100:00100000:0.0:1788586997.904079:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.904159:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set 00000000878b0bbb going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.904195:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309850752 00000100:00100000:2.0:1788586997.904200:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309850752 00000100:00100000:2.0:1788586997.904223:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788586997.904229:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da8f85df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850752:12345-0@lo:1000: 00000100:00100000:0.0:1788586997.975909:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da8f85df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7608:x1875469309850752:12345-0@lo:1000: Request processed in 71669us (71819us total) trans 4294967297 rc 0/0 00000001:00080000:2.0:1788586997.975951:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000100:00100000:0.0:1788586997.975952:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586997.976049:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850752:0@lo:1000: 00000100:00100000:0.0:1788586997.976150:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000913f1811 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850880:0@lo:1000: 00000100:00100000:0.0:1788586997.976202:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.976249:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c3b22b8 going to sleep for 11 seconds 00000100:00100000:3.0:1788586997.976269:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309850880 00000100:00100000:3.0:1788586997.976280:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309850880 00000100:00100000:3.0:1788586997.976340:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788586997.976351:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c4c9006 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850880:12345-0@lo:1000: 00000100:00100000:3.0:1788586997.976459:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c4c9006 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7608:x1875469309850880:12345-0@lo:1000: Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.976466:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788586997.976488:0:7608:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000004:00080000:0.0:1788586997.976494:0:7608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788586997.976514:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000913f1811 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7608:1875469309850880:0@lo:1000: 00000040:00080000:0.0:1788586997.976654:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788586997.976690:0:7608:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000035e71ecd with version 1 00000004:00080000:1.0:1788586997.978663:0:7606:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000281da277 version 1 rpc_version 1 00000020:00100000:1.0:1788586997.978715:0:7606:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788586997.978726:0:7606:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000002785c8c x1875469309851136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788586997.978759:0:7606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7606:1875469309851136:0@lo:1000: 00000100:00100000:1.0:1788586997.978870:0:7606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586997.978910:0:7606:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db12fdab going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.979913:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309851136 00000100:00100000:1.0:1788586997.979926:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309851136 00000100:00100000:1.0:1788586997.980002:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788586997.980012:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040f19fef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7606:x1875469309851136:12345-0@lo:1000: 00000001:00100000:2.0:1788586997.981182:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:0.0:1788586997.982261:0:7608:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788586997.982371:0:7608:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788586997.982378:0:7608:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788586998.045242:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788586998.045426:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040f19fef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7606:x1875469309851136:12345-0@lo:1000: Request processed in 65410us (66551us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788586998.045455:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788586998.045550:0:7606:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788586998.045556:0:7606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788586998.045579:0:7606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7606:1875469309851136:0@lo:1000: 00010000:00010000:3.0:1788586998.187034:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586999.211006:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587000.239242:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788587000.909501:0:7736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5ef28720 20000000:00000080:0.0:1788587000.909530:0:7736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbf36d45400 uarg=0000000000000000 20000000:01000000:0.0:1788587000.909580:0:7736:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788587000.909588:0:7736:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788587000.909595:0:7736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788587000.910037:0:7736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788587000.910054:0:7736:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788587000.915566:0:7736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587000.916290:0:7736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788587000.916380:0:7736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788587000.916438:0:7736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788587000.916463:0:7736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788587000.916490:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587000.916524:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 17 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587000.916532:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63434db expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587000.916539:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587000.916592:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63434db expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587000.916612:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63434db expref: 17 pid: 6464 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587000.916630:0:7736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000913f1811 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7736:1875469309851264:0@lo:104: 00000100:00100000:0.0:1788587000.916719:0:7736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587000.916833:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 17 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587000.916840:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 17 pid: 6467 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587000.916848:0:7736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7736:1875469309851392:0@lo:104: 00000100:00100000:0.0:1788587000.916869:0:7736:0:(client.c:2716:ptlrpc_set_wait()) set 00000000749bd759 going to sleep for 11 seconds 00000100:00100000:2.0:1788587000.917036:0:6455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788587000.917058:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587000.917092:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309851264 00000100:00100000:2.0:1788587000.917101:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309851264 00000100:00100000:2.0:1788587000.917149:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309851392 00000100:00100000:2.0:1788587000.917151:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309851392 00000100:00100000:2.0:1788587000.917166:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587000.917174:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ea82ba5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:7736:x1875469309851264:12345-0@lo:104: 00010000:00010000:2.0:1788587000.917200:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.917263:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587000.917268:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ea82ba5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:7736:x1875469309851264:12345-0@lo:104: Request processed in 95us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587000.917277:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587000.917321:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587000.917327:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000254153fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:7736:x1875469309851392:12345-0@lo:104: 00010000:00010000:2.0:1788587000.917335:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.917373:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587000.917378:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000254153fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:7736:x1875469309851392:12345-0@lo:104: Request processed in 52us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587000.917384:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788587000.919279:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587000.919295:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919310:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003849fcea already unused, calling callback (000000009a9b2dd3) 10000000:00010000:1.0:1788587000.919314:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919324:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587000.919347:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587000.919353:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788587000.919428:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919436:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587000.919454:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919461:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 000000003849fcea/0x419e1ae1f63434db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434e2 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919475:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587000.919478:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919483:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ce18df7 already unused, calling callback (000000009a9b2dd3) 10000000:00010000:1.0:1788587000.919484:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919490:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587000.919496:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587000.919501:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788587000.919522:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919528:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587000.919546:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919552:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 000000007ce18df7/0x419e1ae1f63433ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63433f4 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.919568:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587000.919569:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587000.919571:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587000.919579:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587000.919651:0:7736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000913f1811 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7736:1875469309851264:0@lo:104: 00000100:00100000:1.0:1788587000.919667:0:7736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050dbf767 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7736:1875469309851392:0@lo:104: 00010000:00010000:1.0:1788587000.919701:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587000.919745:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587000.919765:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309851648:0@lo:103: 00000100:00100000:1.0:1788587000.919876:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587000.919942:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309851648 00000100:00100000:1.0:1788587000.919952:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309851648 00010000:00010000:1.0:1788587000.919993:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 18 pid: 6467 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587000.920026:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587000.920035:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f6672a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+18:3473:x1875469309851648:12345-0@lo:103: 00010000:00010000:1.0:1788587000.920050:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587000.920063:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 18 pid: 6467 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.920073:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 18 pid: 6467 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.920089:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e54e4e9c/0x419e1ae1f63433f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63433ed expref: 18 pid: 6467 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.920105:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587000.920141:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f6672a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+17:3473:x1875469309851648:12345-0@lo:103: Request processed in 108us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587000.920149:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587000.920608:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309851520:0@lo:103: 00000100:00100000:2.0:1788587000.920645:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587000.920700:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309851520 00000100:00100000:2.0:1788587000.920711:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309851520 00010000:00010000:2.0:1788587000.920731:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63434db expref: 17 pid: 6464 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587000.920754:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587000.920760:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068d8eda6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+17:3475:x1875469309851520:12345-0@lo:103: 00010000:00010000:2.0:1788587000.920767:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587000.920771:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63434db expref: 17 pid: 6464 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920780:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63434db expref: 17 pid: 6464 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920790:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002da508f4/0x419e1ae1f63434e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63434db expref: 17 pid: 6464 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920825:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920834:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920849:0:6458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920857:0:6458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920863:0:6458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920868:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920880:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005218c1e9 already unused, calling callback (00000000158838a5) 00010000:00010000:2.0:1788587000.920885:0:6458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920893:0:6458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920907:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587000.920917:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587000.920943:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068d8eda6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+16:3475:x1875469309851520:12345-0@lo:103: Request processed in 184us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587000.920949:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587000.920977:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002785c8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309851520:0@lo:103: 00000100:00100000:1.0:1788587000.921036:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309851648:0@lo:103: 00010000:00010000:0.0:1788587000.921496:0:7736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587000.921508:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587000.921521:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005218c1e9/0x419e1ae1f6343575 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587001.261915:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587002.282997:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587002.415510:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309851776:0@lo:41: 00000100:00100000:2.0:1788587002.415589:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587002.420253:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309851776 00000100:00100000:1.0:1788587002.420268:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309851776 00000100:00100000:1.0:1788587002.420332:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587002.420340:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6ae4ba8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309851776:12345-0@lo:41: 00000004:00000024:1.0:1788587002.420391:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788587002.420486:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6ae4ba8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309851776:12345-0@lo:41: Request processed in 146us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587002.420493:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587002.421305:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0433dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309851776:0@lo:41: 00000100:00100000:0.0:1788587002.928363:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b82a1e42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309851904:0@lo:41: 00000100:00100000:0.0:1788587002.928435:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587002.928523:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309851904 00000100:00100000:0.0:1788587002.928530:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309851904 00000100:00100000:0.0:1788587002.928573:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587002.928581:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050dbf767 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309851904:12345-0@lo:41: 00000004:00000024:0.0:1788587002.928626:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587002.928671:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050dbf767 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309851904:12345-0@lo:41: Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587002.928677:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587002.928716:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b82a1e42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309851904:0@lo:41: 00000100:00100000:1.0:1788587002.932900:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587002.932925:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082763ff8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309852032:0@lo:400: 00000100:00100000:1.0:1788587002.932995:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587002.933053:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abfe3c51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309852160:0@lo:400: 00000100:00100000:1.0:1788587002.933080:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587002.933113:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587002.933118:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccb71263 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309852288:0@lo:400: 00000100:00100000:1.0:1788587002.933139:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587002.933166:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309852032 00000100:00100000:1.0:1788587002.933174:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309852032 00000100:00100000:1.0:1788587002.933213:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587002.933221:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004790f198 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:3474:x1875469309852032:12345-0@lo:400: 00000100:00100000:1.0:1788587002.933264:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004790f198 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:3474:x1875469309852032:12345-0@lo:400: Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587002.933271:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587002.933299:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309852160 00000100:00100000:1.0:1788587002.933303:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309852160 00000100:00100000:1.0:1788587002.933323:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309852288 00000100:00100000:1.0:1788587002.933325:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309852288 00000100:00100000:1.0:1788587002.933336:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587002.933340:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010ba80ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309852160:12345-0@lo:400: 00000100:00100000:1.0:1788587002.933381:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010ba80ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309852160:12345-0@lo:400: Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587002.933386:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587002.933396:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587002.933400:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0433dfb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309852288:12345-0@lo:400: 00000100:00100000:1.0:1788587002.933418:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0433dfb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309852288:12345-0@lo:400: Request processed in 19us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587002.933423:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587002.933453:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082763ff8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309852032:0@lo:400: 00010000:00080000:1.0:1788587002.933479:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ccb71263 x1875469309852288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587002.933501:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccb71263 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309852288:0@lo:400: 00010000:00080000:1.0:1788587002.933510:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000abfe3c51 x1875469309852160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587002.933516:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abfe3c51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309852160:0@lo:400: 00010000:00010000:0.0:1788587003.306947:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587003.819757:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587003.819766:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf04818800 from 1 10000000:01000000:2.0:1788587003.819772:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587003.819844:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000cf22833c/0x419e1ae1f634357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.819857:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000cf22833c/0x419e1ae1f634357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.819868:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000cf22833c/0x419e1ae1f634357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587003.819901:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6028baa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309852416:0@lo:101: 00000100:00100000:2.0:1788587003.819969:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587003.820028:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf10ede4 going to sleep for 11 seconds 00000100:00100000:1.0:1788587003.820116:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309852416 00000100:00100000:1.0:1788587003.820125:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309852416 00000100:00100000:1.0:1788587003.820180:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587003.820189:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084d4fc28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309852416:12345-0@lo:101: 00010000:00010000:1.0:1788587003.820203:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587003.820215:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006b95312/0x419e1ae1f6343583 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634357c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587003.820237:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006b95312/0x419e1ae1f6343583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634357c expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587003.820247:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006b95312/0x419e1ae1f6343583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634357c expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587003.820255:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006b95312, rc 0) 00000100:00100000:1.0:1788587003.820296:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084d4fc28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309852416:12345-0@lo:101: Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.820302:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587003.820502:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6028baa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309852416:0@lo:101: 00010000:00010000:2.0:1788587003.820516:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000cf22833c/0x419e1ae1f634357c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.820903:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000cf22833c/0x419e1ae1f634357c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587003.821513:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6028baa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309852544:0@lo:501: 00000100:00100000:2.0:1788587003.821627:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587003.821665:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf10ede4 going to sleep for 11 seconds 00000100:00100000:1.0:1788587003.821675:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309852544 00000100:00100000:1.0:1788587003.821681:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309852544 00000100:00100000:1.0:1788587003.821721:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587003.821728:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022c22eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309852544:12345-0@lo:501: 00000100:00100000:1.0:1788587003.822022:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022c22eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309852544:12345-0@lo:501: Request processed in 295us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.822029:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788587003.822324:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6028baa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309852544:0@lo:501: 00000100:00100000:3.0:1788587003.822370:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771d2aee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309852672:0@lo:503: 00000100:00100000:3.0:1788587003.822421:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587003.822444:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000098c38ff5 going to sleep for 11 seconds 00000100:00100000:1.0:1788587003.822474:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309852672 00000100:00100000:1.0:1788587003.822479:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309852672 00000100:00100000:1.0:1788587003.823632:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587003.823657:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013f04f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309852672:12345-0@lo:503: 00000100:00100000:1.0:1788587003.823937:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013f04f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309852672:12345-0@lo:503: Request processed in 284us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.823945:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587003.824645:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771d2aee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309852672:0@lo:503: 00000100:00100000:1.0:1788587003.825267:0:7970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abfe3c51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7970:1875469309852800:0@lo:502: 00000100:00100000:1.0:1788587003.825328:0:7970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587003.825410:0:7970:0:(client.c:2716:ptlrpc_set_wait()) set 0000000015301be2 going to sleep for 11 seconds 00000100:00100000:2.0:1788587003.825510:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309852800 00000100:00100000:2.0:1788587003.825517:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309852800 00000100:00100000:2.0:1788587003.825713:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788587003.825723:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075712bd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:7970:x1875469309852800:12345-0@lo:502: 00000100:00100000:2.0:1788587003.826000:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075712bd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:7970:x1875469309852800:12345-0@lo:502: Request processed in 279us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587003.826008:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587003.826231:0:7970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abfe3c51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7970:1875469309852800:0@lo:502: 00000020:01000000:1.0:1788587003.826262:0:7970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587003.826271:0:7970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587003.826274:0:7970:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788587003.826282:0:7970:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf04818800 00000020:00000080:1.0:1788587003.826284:0:7970:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788587003.826327:0:7970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7970:1875469309852928:0@lo:502: 00000100:00100000:1.0:1788587003.826375:0:7970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587003.826402:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309852928 00000100:00100000:1.0:1788587003.826406:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309852928 00000100:00100000:1.0:1788587003.826434:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587003.826441:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:7970:x1875469309852928:12345-0@lo:502: 00000100:00100000:1.0:1788587003.827030:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:7970:x1875469309852928:12345-0@lo:502: Request processed in 588us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.827038:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587003.827080:0:7970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587003.827258:0:7970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7970:1875469309852928:0@lo:502: 00000020:01000000:1.0:1788587003.827279:0:7970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587003.827285:0:7970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587003.827287:0:7970:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788587003.827290:0:7970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788587003.827854:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788587003.827875:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587003.827886:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.827897:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587003.827914:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587003.827917:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf11802800 from 1 10000000:01000000:2.0:1788587003.827920:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587003.827950:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.827958:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.827968:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587003.827983:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309853056:0@lo:101: 00000100:00100000:2.0:1788587003.828021:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587003.828050:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0393f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587003.828051:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309853056 00000100:00100000:1.0:1788587003.828057:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309853056 00000100:00100000:1.0:1788587003.828204:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587003.828213:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309853056:12345-0@lo:101: 00010000:00010000:1.0:1788587003.828224:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587003.828236:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634358a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587003.828256:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634358a expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587003.828267:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634358a expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587003.828275:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cda00, rc 0) 00000100:00100000:1.0:1788587003.828309:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309853056:12345-0@lo:101: Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.828316:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587003.828334:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309853056:0@lo:101: 00010000:00010000:2.0:1788587003.828359:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.828369:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587003.828417:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309853184:0@lo:501: 00000100:00100000:2.0:1788587003.828442:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587003.828461:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0393f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587003.829248:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309853184 00000100:00100000:1.0:1788587003.829261:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309853184 00000100:00100000:1.0:1788587003.829301:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788587003.829309:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309853184:12345-0@lo:501: 00000100:00100000:1.0:1788587003.830399:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309853184:12345-0@lo:501: Request processed in 1086us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.830411:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587003.830485:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309853184:0@lo:501: 00000100:00100000:2.0:1788587003.830665:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309853312:0@lo:503: 00000100:00100000:2.0:1788587003.830717:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587003.830787:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0393f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587003.830855:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309853312 00000100:00100000:1.0:1788587003.830861:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309853312 00000100:00100000:1.0:1788587003.830945:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587003.830955:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309853312:12345-0@lo:503: 00000100:00100000:1.0:1788587003.831178:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309853312:12345-0@lo:503: Request processed in 224us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.831184:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788587003.831337:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309853312:0@lo:503: 00000100:00100000:3.0:1788587003.832949:0:7971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7971:1875469309853440:0@lo:502: 00000100:00100000:3.0:1788587003.833017:0:7971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587003.833057:0:7971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf133b7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587003.833219:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309853440 00000100:00100000:1.0:1788587003.833225:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309853440 00000100:00100000:1.0:1788587003.833270:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587003.833278:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:7971:x1875469309853440:12345-0@lo:502: 00000100:00100000:1.0:1788587003.833633:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:7971:x1875469309853440:12345-0@lo:502: Request processed in 355us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.833642:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788587003.833660:0:7971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7971:1875469309853440:0@lo:502: 00000020:01000000:3.0:1788587003.833689:0:7971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587003.833698:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587003.833700:0:7971:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788587003.833708:0:7971:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf11802800 00000020:00000080:3.0:1788587003.833711:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587003.833733:0:7971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7971:1875469309853568:0@lo:502: 00000100:00100000:3.0:1788587003.833769:0:7971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587003.833870:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309853568 00000100:00100000:1.0:1788587003.833875:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309853568 00000100:00100000:1.0:1788587003.833942:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587003.833950:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:7971:x1875469309853568:12345-0@lo:502: 00000100:00100000:1.0:1788587003.834063:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:7971:x1875469309853568:12345-0@lo:502: Request processed in 114us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.834070:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788587003.834127:0:7971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf133b7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587003.834139:0:7971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:7971:1875469309853568:0@lo:502: 00000020:01000000:3.0:1788587003.834155:0:7971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587003.834159:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587003.834161:0:7971:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788587003.834164:0:7971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788587003.834774:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788587003.834910:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587003.834922:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.834933:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587004.337710:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587005.361987:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587006.070956:0:8097:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788587006.070961:0:8097:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788587006.071220:0:8097:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbf3d10b000 00000020:01000004:1.0:1788587006.071236:0:8097:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788587006.071249:0:8097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788587006.071274:0:8097:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cbf3b8899c0) 00000020:00000080:1.0:1788587006.071290:0:8097:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788587006.089346:0:8097:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788587006.089622:0:8097:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788587006.121298:0:8097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788587006.125747:0:8097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788587006.125780:0:8097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788587006.125873:0:8097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788587006.125900:0:8097:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788587006.126229:0:8097:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788587006.126241:0:8097:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587006.126252:0:8097:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x419e1ae1f634359f 00000020:01000004:2.0:1788587006.126259:0:8097:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788587006.126281:0:8097:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788587006.126284:0:8097:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788587006.126290:0:8097:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788587006.126295:0:8097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788587006.126315:0:8097:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cbf41a319c0) 00000020:00000080:2.0:1788587006.126340:0:8097:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788587006.127621:0:8097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587006.127777:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788587006.127789:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788587006.130613:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788587006.130628:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788587006.131488:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788587006.131497:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788587006.137647:0:8097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587006.138013:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788587006.138021:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788587006.142296:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788587006.142314:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788587006.170673:0:8097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587006.171540:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788587006.171547:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788587006.173609:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788587006.173624:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788587006.175431:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788587006.175446:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788587006.178735:0:8097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587006.179452:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788587006.179459:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788587006.180426:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587006.180444:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788587006.233623:0:8097:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587006.233936:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788587006.233943:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788587006.235395:0:8097:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788587006.235406:0:8097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788587006.236126:0:8097:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788587006.236152:0:8097:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788587006.236158:0:8097:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788587006.262619:0:8097:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788587006.262653:0:8097:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788587006.262657:0:8097:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788587006.262659:0:8097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587006.262660:0:8097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587006.262662:0:8097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587006.262667:0:8097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587006.262668:0:8097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587006.262669:0:8097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587006.262670:0:8097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788587006.262672:0:8097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788587006.262673:0:8097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587006.262674:0:8097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587006.262678:0:8097:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788587006.262680:0:8097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788587006.262682:0:8097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587006.262683:0:8097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587006.262684:0:8097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587006.262685:0:8097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587006.262686:0:8097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587006.262687:0:8097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587006.262688:0:8097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788587006.262689:0:8097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788587006.262690:0:8097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587006.262691:0:8097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587006.262718:0:8097:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788587006.262734:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309853696:0@lo:253: 00000100:00100000:0.0:1788587006.262835:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.262942:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf13278a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.262991:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309853696 00000100:00100000:1.0:1788587006.262998:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309853696 00000100:00100000:1.0:1788587006.263097:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788587006.263107:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:8097:x1875469309853696:12345-0@lo:253: 20000000:01000000:1.0:1788587006.263136:0:6467:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788587006.263141:0:6467:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788587006.263145:0:6467:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788587006.263148:0:6467:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788587006.264772:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587006.265503:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788587006.265519:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788587006.265561:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788587006.265570:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788587006.265600:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788587006.265650:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788587006.266081:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788587006.266101:0:6467:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:1.0:1788587006.266103:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788587006.266140:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788587006.266148:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788587006.266420:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788587006.266431:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:1.0:1788587006.266466:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788587006.266480:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788587006.266522:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788587006.266575:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788587006.267108:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788587006.267123:0:6467:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:1.0:1788587006.267125:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788587006.267159:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788587006.267436:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788587006.267499:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788587006.267509:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:1.0:1788587006.267544:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788587006.267553:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788587006.267601:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788587006.267656:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788587006.268686:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788587006.268706:0:6467:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:1.0:1788587006.268708:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788587006.268743:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788587006.268751:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788587006.268782:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788587006.268788:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:1.0:1788587006.268895:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788587006.268906:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788587006.268954:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788587006.268993:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788587006.269010:0:6467:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788587006.269012:0:6467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788587006.269019:0:6467:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788587006.269020:0:6467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788587006.269022:0:6467:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788587006.269034:0:6467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788587006.269037:0:6467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788587006.269077:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788587006.269079:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788587006.270043:0:8112:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788587006.270108:0:8112:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788587006.270424:0:8112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788587006.270768:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788587006.270945:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788587006.271026:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788587006.271041:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788587006.271043:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788587006.271557:0:8113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788587006.271787:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788587006.271861:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788587006.271921:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788587006.271934:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788587006.271936:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788587006.272698:0:8114:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788587006.272751:0:8114:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788587006.272834:0:8114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788587006.273064:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788587006.273103:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788587006.273155:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788587006.273180:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788587006.273183:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788587006.274033:0:8115:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788587006.274087:0:8115:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788587006.275900:0:8115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788587006.276518:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788587006.276568:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788587006.276605:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1788587006.276623:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788587006.276642:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276661:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276669:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf01483c00/0x419e1ae1f63434f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276676:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276689:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634353d expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276695:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f634356e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276701:0:6467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276740:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f634356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276755:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f634356e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 18 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.276768:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03639180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309853824:0@lo:104: 00000100:00100000:2.0:1788587006.276864:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587006.276919:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634353d expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276928:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634353d expref: 18 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.276937:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309853952:0@lo:104: 00000100:00100000:2.0:1788587006.276957:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587006.276984:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.276992:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343528 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 18 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.277006:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309854080:0@lo:104: 00000100:00100000:2.0:1788587006.277037:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587006.277057:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf01483c00/0x419e1ae1f63434f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.277066:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf01483c00/0x419e1ae1f63434f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 18 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.277073:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309854208:0@lo:104: 00000100:00100000:2.0:1788587006.277103:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587006.277124:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.277132:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 18 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.277141:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309854336:0@lo:104: 00000100:00100000:2.0:1788587006.277160:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.277170:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587006.277338:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309853824 00000100:00100000:3.0:1788587006.277345:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309853824 00000100:00100000:3.0:1788587006.277381:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309853952 00000100:00100000:3.0:1788587006.277384:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309853952 00000100:00100000:3.0:1788587006.277393:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309854080 00000100:00100000:3.0:1788587006.277395:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309854080 00000100:00100000:3.0:1788587006.277403:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309854208 00000100:00100000:3.0:1788587006.277405:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309854208 00000100:00100000:3.0:1788587006.277412:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309854336 00000100:00100000:3.0:1788587006.277414:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309854336 00000100:00100000:3.0:1788587006.277426:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587006.277435:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+7:6467:x1875469309853824:12345-0@lo:104: 00010000:00010000:3.0:1788587006.277447:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f6343567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.277506:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587006.277512:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+7:6467:x1875469309853824:12345-0@lo:104: Request processed in 79us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.277519:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587006.277535:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587006.277541:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+6:6467:x1875469309853952:12345-0@lo:104: 00010000:00010000:3.0:1788587006.277562:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f634353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.277598:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587006.277603:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+6:6467:x1875469309853952:12345-0@lo:104: Request processed in 63us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.277609:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587006.277621:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587006.277627:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+5:6467:x1875469309854080:12345-0@lo:104: 00010000:00010000:3.0:1788587006.277635:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f6343521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277651:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587006.277661:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f6343567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.277663:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587006.277673:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+5:6467:x1875469309854080:12345-0@lo:104: Request processed in 45us (635us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587006.277676:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc1cf1c20) 00000100:00100000:3.0:1788587006.277683:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:00010000:1.0:1788587006.277683:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f6343567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277697:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f6343567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587006.277699:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587006.277710:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:6467:x1875469309854208:12345-0@lo:104: 10000000:00010000:1.0:1788587006.277711:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f6343567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.277721:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f63434e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587006.277727:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587006.277756:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788587006.277762:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:6467:x1875469309854208:12345-0@lo:104: Request processed in 54us (659us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587006.277763:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f6343567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587006.277773:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788587006.277787:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788587006.277789:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587006.277820:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6467:x1875469309854336:12345-0@lo:104: 00010000:00010000:1.0:1788587006.277830:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f6343567 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.277834:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f6343472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277840:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f6343567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634356e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277860:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587006.277864:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f634353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277870:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587006.277873:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f634353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277880:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f634353d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.277885:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:1.0:1788587006.277886:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f634353d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587006.277896:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788587006.277897:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6467:x1875469309854336:12345-0@lo:104: Request processed in 76us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.277906:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788587006.277913:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f634353d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277921:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587006.277926:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587006.277928:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f634353d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277937:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f634353d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343544 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277953:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587006.277956:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f63434e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.277963:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587006.277966:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f63434e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.278052:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587006.278059:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f6343521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.278066:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587006.278069:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f6343521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.278076:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f6343521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587006.278083:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f6343521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587006.278089:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587006.278106:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f6343521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.278112:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587006.278128:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f6343521 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.278144:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f6343521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343528 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.278155:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587006.278157:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587006.278159:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587006.278502:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309854592:0@lo:103: 00000100:00100000:2.0:1788587006.278540:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.278638:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587006.278645:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309854464:0@lo:103: 00000100:00100000:2.0:1788587006.278666:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587006.279645:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f63434e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587006.279653:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f63434e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587006.279660:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587006.279701:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f63434e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.279707:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587006.279716:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f63434e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.279743:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f63434e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63434f0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.279768:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587006.279770:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587006.279772:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587006.279809:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309854720:0@lo:103: 00000100:00100000:1.0:1788587006.279871:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309854848:0@lo:103: 00010000:00010000:3.0:1788587006.284378:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587006.284385:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587006.284387:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587006.284869:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f6343472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.284884:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587006.284896:0:8116:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f6343472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.284907:0:8116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f6343472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587006.284914:0:8116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f6343472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587006.284920:0:8116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788587006.284998:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.285054:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309854592 00010000:00010000:1.0:1788587006.285060:0:8116:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f6343472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587006.285063:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309854592 00010000:00010000:1.0:1788587006.285071:0:8116:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587006.285093:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f6343472 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.285103:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f6343472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343479 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.285103:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343544 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634353d expref: 19 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587006.285152:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309854976:0@lo:103: 00000100:00100000:3.0:1788587006.285165:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309854464 00000100:00100000:3.0:1788587006.285170:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309854464 00010000:00010000:3.0:1788587006.285191:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f634356e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 20 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.285218:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587006.285221:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587006.285224:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587006.285233:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587006.285252:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+20:3475:x1875469309854592:12345-0@lo:103: 00010000:00010000:3.0:1788587006.285265:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587006.285272:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343544 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634353d expref: 20 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.285281:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634353d expref: 20 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.285297:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587006.285341:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+20:3475:x1875469309854592:12345-0@lo:103: Request processed in 100us (6801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.285348:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587006.285365:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587006.285371:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+19:3475:x1875469309854464:12345-0@lo:103: 00010000:00010000:3.0:1788587006.285385:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587006.285389:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f634356e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 19 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.285399:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f634356e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 19 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.285408:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587006.285432:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+19:3475:x1875469309854464:12345-0@lo:103: Request processed in 61us (6765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.285438:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587006.285826:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309854464:0@lo:103: 00000100:00100000:2.0:1788587006.285839:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309854592:0@lo:103: 00000100:00100000:2.0:1788587006.285880:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587006.285920:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f634356e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343567 expref: 18 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.285931:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03639180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309853824:0@lo:104: 00010000:00010000:2.0:1788587006.285941:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634353d expref: 17 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.285948:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309853952:0@lo:104: 00000100:00100000:2.0:1788587006.285956:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309854080:0@lo:104: 00000100:00100000:2.0:1788587006.285963:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309854208:0@lo:104: 00000100:00100000:2.0:1788587006.285969:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309854336:0@lo:104: 00010000:00010000:2.0:1788587006.285992:0:6467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587006.286104:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.286544:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309854848 00000100:00100000:3.0:1788587006.286551:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309854848 00010000:00010000:3.0:1788587006.286579:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf01483c00/0x419e1ae1f63434f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 17 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587006.286595:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309854720 00000100:00100000:3.0:1788587006.286598:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309854720 00010000:00010000:3.0:1788587006.286608:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343528 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 18 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587006.286616:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309854976 00000100:00100000:3.0:1788587006.286619:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309854976 00010000:00010000:3.0:1788587006.286627:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 19 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587006.286638:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587006.286644:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+19:3473:x1875469309854848:12345-0@lo:103: 00010000:00010000:3.0:1788587006.286654:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587006.286659:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf01483c00/0x419e1ae1f63434f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 19 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286677:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf01483c00/0x419e1ae1f63434f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 19 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286690:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01483c00/0x419e1ae1f63434f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63434e9 expref: 19 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286700:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587006.286754:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+18:3473:x1875469309854848:12345-0@lo:103: Request processed in 109us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.286760:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587006.286774:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587006.286780:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+17:3472:x1875469309854720:12345-0@lo:103: 00010000:00010000:3.0:1788587006.286787:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587006.286812:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343528 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 17 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286822:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 17 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286831:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343521 expref: 17 pid: 6465 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286839:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587006.286870:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+16:3472:x1875469309854720:12345-0@lo:103: Request processed in 90us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.286876:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587006.286887:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587006.286894:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+15:3474:x1875469309854976:12345-0@lo:103: 00010000:00010000:3.0:1788587006.286907:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587006.286912:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 15 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286920:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 15 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286929:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343472 expref: 15 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286939:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286946:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286960:0:6457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286967:0:6457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286974:0:6457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286980:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.286985:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587006.286989:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.287007:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.287021:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.287030:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587006.287062:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+14:3474:x1875469309854976:12345-0@lo:103: Request processed in 169us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.287069:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587006.287134:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309854720:0@lo:103: 00000100:00100000:3.0:1788587006.287199:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309854976:0@lo:103: 00000100:00100000:2.0:1788587006.287525:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309854848:0@lo:103: 00010000:00010000:2.0:1788587006.287546:0:6467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.287554:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.287560:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587006.287574:0:6467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788587006.342363:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+13:8097:x1875469309853696:12345-0@lo:253: Request processed in 79249us (79519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.342378:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587006.342468:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309853696:0@lo:253: 10000000:01000000:0.0:1788587006.342484:0:8097:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788587006.342487:0:8097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587006.342489:0:8097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587006.342490:0:8097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587006.342491:0:8097:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788587006.342492:0:8097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587006.342493:0:8097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587006.342495:0:8097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587006.342511:0:8097:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788587006.342513:0:8097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587006.342514:0:8097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788587006.342534:0:8097:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbf3d10b000 from lustre-OST0000 10000000:01000000:0.0:1788587006.342636:0:8097:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788587006.342639:0:8097:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788587006.342647:0:8097:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf053a99c0 local copy 10000000:01000000:0.0:1788587006.342651:0:8097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788587006.342688:0:8097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.342700:0:8097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.342709:0:8097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587006.342728:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855104:0@lo:101: 00000100:00100000:0.0:1788587006.342771:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.342881:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.342970:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309855104 00000100:00100000:1.0:1788587006.342976:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309855104 00000100:00100000:1.0:1788587006.343056:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788587006.343065:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+13:8097:x1875469309855104:12345-0@lo:101: 00010000:00010000:1.0:1788587006.343077:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587006.343090:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f63435bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63435b4 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.343114:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f63435bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63435b4 expref: 14 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.343126:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f63435bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63435b4 expref: 14 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.343136:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc200, rc 0) 00000100:00100000:1.0:1788587006.343180:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855104:12345-0@lo:101: Request processed in 116us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.343187:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587006.343250:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855104:0@lo:101: 00010000:00010000:0.0:1788587006.343264:0:8097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.343272:0:8097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587006.343395:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855232:0@lo:501: 00000100:00100000:0.0:1788587006.343423:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.343492:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587006.343658:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309855232 00000100:00100000:2.0:1788587006.343663:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309855232 00000100:00100000:2.0:1788587006.343693:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587006.343700:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855232:12345-0@lo:501: 00000100:00100000:2.0:1788587006.343944:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855232:12345-0@lo:501: Request processed in 243us (519us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587006.343951:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788587006.344034:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855232:0@lo:501: 10000000:01000000:0.0:1788587006.344055:0:8097:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788587006.344085:0:8097:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788587006.344091:0:8097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.344099:0:8097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.344107:0:8097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.344133:0:8097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788587006.344152:0:8097:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbf3d10b000 10000000:01000000:0.0:1788587006.344157:0:8097:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788587006.344162:0:8097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788587006.344164:0:8097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587006.344169:0:8097:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788587006.344171:0:8097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788587006.344190:0:8097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.344198:0:8097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.344206:0:8097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587006.344219:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855360:0@lo:101: 00000100:00100000:0.0:1788587006.344245:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.344272:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d000 going to sleep for 11 seconds 00010000:00010000:2.0:1788587006.344469:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587006.344475:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344483:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587006.344486:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344494:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587006.344501:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587006.344507:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587006.344529:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344534:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587006.344569:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344576:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f63435b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f63435bb expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344599:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587006.344601:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587006.344602:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587006.344610:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587006.344622:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309855488:0@lo:103: 00000100:00100000:2.0:1788587006.344650:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.344679:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309855488 00000100:00100000:2.0:1788587006.344684:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309855488 00000100:00100000:2.0:1788587006.344718:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587006.344726:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+14:3474:x1875469309855488:12345-0@lo:103: 00010000:00010000:2.0:1788587006.344736:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587006.344748:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f63435bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63435b4 expref: 14 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344762:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587006.344788:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+13:3474:x1875469309855488:12345-0@lo:103: Request processed in 63us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.344832:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587006.344873:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309855488:0@lo:103: 00000100:00100000:2.0:1788587006.344890:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309855360 00000100:00100000:2.0:1788587006.344893:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309855360 00000100:00100000:2.0:1788587006.344907:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788587006.344912:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+13:8097:x1875469309855360:12345-0@lo:101: 00010000:00010000:2.0:1788587006.344920:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587006.344930:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63435c2 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344957:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 14 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344967:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 14 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.344974:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044e00, rc 0) 00000100:00100000:2.0:1788587006.345003:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855360:12345-0@lo:101: Request processed in 89us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.345008:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788587006.345182:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855360:0@lo:101: 00010000:00010000:0.0:1788587006.345195:0:8097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.345205:0:8097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587006.345279:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855616:0@lo:501: 00000100:00100000:0.0:1788587006.345304:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.345340:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587006.345390:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309855616 00000100:00100000:2.0:1788587006.345395:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309855616 00000100:00100000:2.0:1788587006.345413:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788587006.345418:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855616:12345-0@lo:501: 00000100:00100000:2.0:1788587006.345730:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855616:12345-0@lo:501: Request processed in 310us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.345738:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788587006.346243:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855616:0@lo:501: 00000100:00100000:1.0:1788587006.346364:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855744:0@lo:503: 00000100:00100000:1.0:1788587006.346413:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.346476:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587006.346522:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309855744 00000100:00100000:2.0:1788587006.346527:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309855744 00000100:00100000:2.0:1788587006.346674:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788587006.346684:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855744:12345-0@lo:503: 00000100:00100000:2.0:1788587006.346886:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855744:12345-0@lo:503: Request processed in 203us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.346893:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788587006.346966:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855744:0@lo:503: 00000040:00080000:0.0:1788587006.347213:0:8097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587006.347270:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855872:0@lo:502: 00000100:00100000:0.0:1788587006.347309:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.347594:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.347667:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309855872 00000100:00100000:1.0:1788587006.347673:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309855872 00000100:00100000:1.0:1788587006.347699:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788587006.347712:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855872:12345-0@lo:502: 00000100:00100000:1.0:1788587006.347878:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309855872:12345-0@lo:502: Request processed in 166us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.347885:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788587006.348040:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309855872:0@lo:502: 00000040:00080000:0.0:1788587006.348293:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788587006.348355:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788587006.348393:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788587006.348447:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788587006.348484:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788587006.348518:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788587006.348614:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856000:0@lo:502: 00000100:00100000:0.0:1788587006.348654:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.348686:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.348832:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309856000 00000100:00100000:1.0:1788587006.348838:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309856000 00000100:00100000:1.0:1788587006.348863:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587006.348870:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309856000:12345-0@lo:502: 00000100:00100000:1.0:1788587006.349019:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309856000:12345-0@lo:502: Request processed in 148us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.349026:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788587006.349117:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856000:0@lo:502: 00000040:00080000:0.0:1788587006.349211:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788587006.349221:0:8097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788587006.349753:0:8118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788587006.349761:0:8118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788587006.349767:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587006.349769:0:8118:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788587006.349773:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587006.349824:0:8118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cbe037a8000) 00000020:00000080:0.0:1788587006.349845:0:8118:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788587006.349851:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788587006.349908:0:8118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf3d10b000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788587006.349914:0:8118:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788587006.349921:0:8118:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x419e1ae1f63435d7 00010000:00010000:1.0:1788587006.356718:0:8118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788587006.357219:0:8118:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788587006.360224:0:8118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788587006.360507:0:8118:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788587006.365509:0:8118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788587006.366470:0:8118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788587006.368105:0:8118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788587006.368118:0:8118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587006.368125:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587006.368127:0:8118:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788587006.368131:0:8118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587006.368136:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587006.368137:0:8118:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788587006.368140:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788587006.368142:0:8118:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788587006.368193:0:8118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587006.368197:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587006.368199:0:8118:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788587006.368203:0:8118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788587006.368345:0:8097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788587006.368368:0:8097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788587006.368385:0:8097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.368397:0:8097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587006.368407:0:8097:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf3d10b000 from 1 10000000:01000000:1.0:1788587006.368409:0:8097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587006.368447:0:8097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.368465:0:8097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.368477:0:8097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587006.368500:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856128:0@lo:101: 00000100:00100000:1.0:1788587006.368585:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.368632:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587006.368746:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309856128 00000100:00100000:0.0:1788587006.368754:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309856128 00000100:00100000:0.0:1788587006.368829:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788587006.368839:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309856128:12345-0@lo:101: 00010000:00010000:0.0:1788587006.368852:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587006.368873:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63435de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.368897:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63435de expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.368909:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63435de expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587006.368918:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482a00, rc 0) 00000100:00100000:0.0:1788587006.368961:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856128:12345-0@lo:101: Request processed in 124us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587006.368968:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587006.369056:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856128:0@lo:101: 00010000:00010000:1.0:1788587006.369073:0:8097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.369083:0:8097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587006.369174:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856256:0@lo:501: 00000100:00100000:1.0:1788587006.369198:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.369222:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.369238:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309856256 00000100:00100000:1.0:1788587006.369242:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309856256 00000100:00100000:1.0:1788587006.369274:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587006.369281:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856256:12345-0@lo:501: 00000100:00100000:1.0:1788587006.369516:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856256:12345-0@lo:501: Request processed in 235us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.369524:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587006.369574:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856256:0@lo:501: 00000100:00100000:1.0:1788587006.369600:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856384:0@lo:503: 00000100:00100000:1.0:1788587006.369635:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.369649:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.369661:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309856384 00000100:00100000:1.0:1788587006.369665:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309856384 00000100:00100000:1.0:1788587006.369681:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788587006.369687:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856384:12345-0@lo:503: 00000100:00100000:1.0:1788587006.369862:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856384:12345-0@lo:503: Request processed in 174us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.369869:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788587006.369904:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856384:0@lo:503: 00000040:00080000:1.0:1788587006.370126:0:8097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587006.370175:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856512:0@lo:502: 00000100:00100000:1.0:1788587006.370208:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.370229:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.370242:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309856512 00000100:00100000:1.0:1788587006.370246:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309856512 00000100:00100000:1.0:1788587006.370262:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788587006.370268:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856512:12345-0@lo:502: 00000100:00100000:1.0:1788587006.370409:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856512:12345-0@lo:502: Request processed in 140us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.370416:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788587006.370453:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856512:0@lo:502: 00000040:00080000:1.0:1788587006.370686:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788587006.370734:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788587006.370764:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856640:0@lo:502: 00000100:00100000:1.0:1788587006.370826:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.370847:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.370860:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309856640 00000100:00100000:1.0:1788587006.370863:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309856640 00000100:00100000:1.0:1788587006.370883:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788587006.370889:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856640:12345-0@lo:502: 00000100:00100000:1.0:1788587006.371008:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856640:12345-0@lo:502: Request processed in 118us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.371015:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788587006.371056:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856640:0@lo:502: 00000040:00080000:1.0:1788587006.371125:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788587006.371134:0:8097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788587006.380012:0:8121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587006.380038:0:8121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587006.380041:0:8121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788587006.380048:0:8121:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf3d10b000 00000020:00000080:1.0:1788587006.380051:0:8121:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587006.380071:0:8121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587006.380074:0:8121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587006.380075:0:8121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788587006.380078:0:8121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788587006.380277:0:8097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788587006.380301:0:8097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587006.380331:0:8097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.380342:0:8097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587006.380385:0:8097:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788587006.380388:0:8097:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbf3d10b000 10000000:01000000:3.0:1788587006.380391:0:8097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbf3d10b000 10000000:01000000:3.0:1788587006.380396:0:8097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587006.380403:0:8097:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf3d10b000 from 1 10000000:01000000:3.0:1788587006.380406:0:8097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587006.380443:0:8097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.380451:0:8097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.380472:0:8097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587006.380494:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856768:0@lo:101: 00000100:00100000:3.0:1788587006.380572:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.380609:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03539cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.380735:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309856768 00000100:00100000:1.0:1788587006.380741:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309856768 00000100:00100000:1.0:1788587006.380790:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788587006.380827:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8097:x1875469309856768:12345-0@lo:101: 00010000:00010000:1.0:1788587006.380840:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587006.380853:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63435ec expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.380887:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.380899:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.380908:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cdc00, rc 0) 00000100:00100000:1.0:1788587006.380954:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309856768:12345-0@lo:101: Request processed in 128us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.380962:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788587006.381132:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856768:0@lo:101: 00010000:00010000:1.0:1788587006.381149:0:8097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.381159:0:8097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587006.381242:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856896:0@lo:501: 00000100:00100000:1.0:1788587006.381270:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.381345:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833480 going to sleep for 11 seconds 00010000:00010000:1.0:1788587006.381969:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587006.382106:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309856896 00000100:00100000:3.0:1788587006.382114:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309856896 00000100:00100000:3.0:1788587006.382176:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788587006.382184:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309856896:12345-0@lo:501: 00000100:00100000:3.0:1788587006.382453:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309856896:12345-0@lo:501: Request processed in 269us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.382460:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788587006.382607:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309856896:0@lo:501: 00000100:00100000:2.0:1788587006.382647:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309857024:0@lo:503: 00000100:00100000:2.0:1788587006.383304:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.385259:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.385715:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309857024 00000100:00100000:1.0:1788587006.385723:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309857024 00000100:00100000:1.0:1788587006.385770:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587006.385779:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309857024:12345-0@lo:503: 00000100:00100000:1.0:1788587006.386034:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309857024:12345-0@lo:503: Request processed in 255us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.386050:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788587006.386209:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309857024:0@lo:503: 00000040:00080000:2.0:1788587006.386561:0:8097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587006.386649:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309857152:0@lo:502: 00000100:00100000:2.0:1788587006.386702:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.386734:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.386917:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309857152 00000100:00100000:1.0:1788587006.386923:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309857152 00000100:00100000:1.0:1788587006.386948:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788587006.386954:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309857152:12345-0@lo:502: 00000100:00100000:1.0:1788587006.387156:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309857152:12345-0@lo:502: Request processed in 201us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.387164:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788587006.387297:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309857152:0@lo:502: 00000040:00080000:2.0:1788587006.387567:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788587006.387621:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788587006.387659:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788587006.387714:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788587006.387750:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788587006.387820:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788587006.387859:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788587006.387890:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788587006.387933:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788587006.387969:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788587006.388006:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788587006.388072:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788587006.388124:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788587006.388155:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788587006.388203:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788587006.388240:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788587006.388275:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788587006.388336:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788587006.388373:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788587006.388403:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788587006.388458:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788587006.388501:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788587006.388550:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788587006.388602:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788587006.388639:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788587006.388673:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788587006.388721:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788587006.388760:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788587006.388840:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788587006.388904:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788587006.388946:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788587006.388981:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788587006.389017:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788587006.389076:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788587006.389114:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788587006.389159:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788587006.389197:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788587006.389241:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309857280:0@lo:502: 00000100:00100000:2.0:1788587006.389309:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.389349:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587006.389632:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309857280 00000100:00100000:1.0:1788587006.389640:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309857280 00000100:00100000:1.0:1788587006.389677:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788587006.389686:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309857280:12345-0@lo:502: 00000100:00100000:1.0:1788587006.389923:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309857280:12345-0@lo:502: Request processed in 237us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.389931:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788587006.390147:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309857280:0@lo:502: 00000040:00080000:2.0:1788587006.390225:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788587006.390236:0:8097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788587006.391269:0:8123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788587006.391286:0:8123:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cbf41a34d40) 00000020:00000080:2.0:1788587006.391309:0:8123:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788587006.391405:0:8123:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf3d10b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788587006.391409:0:8123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf3d10b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788587006.391412:0:8123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf3d10b000 3 00010000:00080000:2.0:1788587006.391441:0:8123:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe03e1b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587006.393453:0:8123:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788587006.393748:0:8123:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788587006.393788:0:8123:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788587006.393827:0:8123:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x419e1ae1f6343601 00000100:00080000:2.0:1788587006.393837:0:8123:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587006.393842:0:8123:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbe03e1b000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587006.393876:0:8123:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0372f480 x1875469309857408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587006.393899:0:8123:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788587006.394165:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309857536:0@lo:400: 00000100:00100000:1.0:1788587006.394224:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.394257:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587006.394262:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309857664:0@lo:400: 00000100:00100000:1.0:1788587006.394283:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.394309:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309857536 00000100:00100000:1.0:1788587006.394315:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309857536 00000100:00100000:1.0:1788587006.394361:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587006.394369:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309857536:12345-0@lo:400: 00000100:00100000:1.0:1788587006.394411:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309857536:12345-0@lo:400: Request processed in 42us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.394426:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788587006.394462:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41745f80 x1875469309857536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587006.394474:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309857536:0@lo:400: 00000100:00100000:3.0:1788587006.394635:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469309857408:0@lo:38: 00000100:00100000:3.0:1788587006.394666:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788587006.394767:0:8123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788587006.394780:0:8123:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8cbf41a30000) 00000100:00100000:1.0:1788587006.395653:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309857408 00000100:00100000:1.0:1788587006.395660:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309857408 00000100:00100000:1.0:1788587006.395685:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587006.395690:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469309857408:12345-0@lo:38: 00000020:00000080:2.0:1788587006.395724:0:8123:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:0.0:1788587006.398154:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309857920:0@lo:400: 00000100:00100000:0.0:1788587006.398225:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.398271:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587006.398279:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309857792:0@lo:400: 00000100:00100000:0.0:1788587006.398305:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587006.398350:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309857664 00000100:00100000:0.0:1788587006.398357:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309857664 00000100:00100000:0.0:1788587006.398390:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309857920 00000100:00100000:0.0:1788587006.398393:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309857920 00000100:00100000:0.0:1788587006.398407:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587006.398415:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309857664:12345-0@lo:400: 00000100:00100000:0.0:1788587006.398472:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309857664:12345-0@lo:400: Request processed in 57us (4186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587006.398478:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587006.398494:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587006.398500:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309857920:12345-0@lo:400: 00000100:00100000:0.0:1788587006.400137:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309857920:12345-0@lo:400: Request processed in 1632us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587006.400149:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587006.400190:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587006.400198:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788587006.400252:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309857664:0@lo:400: 00000100:00100000:0.0:1788587006.400284:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309857920:0@lo:400: 00010000:00080000:1.0:1788587006.404143:0:6472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1788587006.404183:0:6472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x419e1ae1f634360f 00000004:00100000:1.0:1788587006.404200:0:6472:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587006.404234:0:6472:0:(import.c:65:import_set_state_nolock()) ffff8cbf3e058000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587006.404316:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1875469309857408:12345-0@lo:38: Request processed in 8623us (9647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.404337:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788587006.404389:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372f480 x1875469309857408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587006.404400:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587006.404407:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788587006.404412:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788587006.404417:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788587006.404419:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587006.404424:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469309857408:0@lo:38: 00000100:00100000:1.0:1788587006.404452:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309857792 00000100:00100000:1.0:1788587006.404458:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309857792 00000100:00100000:1.0:1788587006.404493:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587006.404500:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309857792:12345-0@lo:400: 00000100:00100000:1.0:1788587006.404551:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309857792:12345-0@lo:400: Request processed in 39us (6233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.404557:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788587006.404584:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41747100 x1875469309857792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587006.404594:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309857792:0@lo:400: 00000020:01000004:2.0:1788587006.405529:0:8123:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf3d10b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788587006.405601:0:8123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf3d10b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788587006.405605:0:8123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf3d10b000 3 00010000:00080000:2.0:1788587006.405636:0:8123:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf3d10c000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587006.411390:0:8123:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788587006.416174:0:8123:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788587006.416218:0:8123:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788587006.416234:0:8123:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x419e1ae1f6343616 00000100:00080000:2.0:1788587006.416245:0:8123:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587006.416252:0:8123:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8cbf3d10c000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587006.416289:0:8123:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0372f800 x1875469309858048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587006.416311:0:8123:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788587006.416732:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469309858048:0@lo:38: 00000100:00100000:1.0:1788587006.416814:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.416871:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309858048 00000100:00100000:1.0:1788587006.416878:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309858048 00000100:00100000:1.0:1788587006.416927:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587006.416935:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469309858048:12345-0@lo:38: 00010000:00080000:1.0:1788587006.416978:0:6473:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1788587006.417048:0:6473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x419e1ae1f634361d 00000004:00100000:1.0:1788587006.417062:0:6473:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587006.417111:0:6473:0:(import.c:65:import_set_state_nolock()) ffff8cbf3e05f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587006.417166:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1875469309858048:12345-0@lo:38: Request processed in 230us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.417183:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788587006.417251:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372f800 x1875469309858048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587006.417277:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587006.417299:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788587006.417307:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788587006.417349:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788587006.417352:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3d10c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587006.417358:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469309858048:0@lo:38: 00000040:00080000:3.0:1788587006.420479:0:8123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788587006.420729:0:8097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788587006.420756:0:8097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788587006.420780:0:8097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.420815:0:8097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788587006.420891:0:8097:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788587006.420893:0:8097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587006.420894:0:8097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587006.420907:0:8097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587006.420909:0:8097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587006.420910:0:8097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587006.420912:0:8097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587006.420913:0:8097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788587006.420914:0:8097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788587006.420916:0:8097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587006.420928:0:8097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587006.420931:0:8097:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788587006.420934:0:8097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587006.420935:0:8097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587006.420943:0:8097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587006.420944:0:8097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587006.420946:0:8097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587006.420947:0:8097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587006.420948:0:8097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587006.420949:0:8097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788587006.420950:0:8097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788587006.420952:0:8097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587006.420953:0:8097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587006.420985:0:8097:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788587006.421023:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309858176:0@lo:253: 00000100:00100000:1.0:1788587006.421095:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587006.421135:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309858176 00000100:00100000:1.0:1788587006.421141:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309858176 00000100:00100000:1.0:1788587006.421181:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788587006.421189:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:8097:x1875469309858176:12345-0@lo:253: 20000000:01000000:1.0:1788587006.421275:0:6467:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788587006.421290:0:6467:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788587006.422079:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083f0c00 going to sleep for 11 seconds 20000000:01000000:2.0:1788587006.474180:0:6467:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788587006.474193:0:6467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788587006.474208:0:6488:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587006.474213:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587006.474233:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.474264:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634351a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.474272:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634352f expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.474279:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.474320:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634352f expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.474344:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343536 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634352f expref: 16 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.474360:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309858304:0@lo:104: 00000100:00100000:2.0:1788587006.474422:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587006.474463:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634351a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.474472:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634351a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 16 pid: 6467 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587006.474480:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309858432:0@lo:104: 00000100:00100000:2.0:1788587006.474496:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587006.474531:0:6456:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788587006.474562:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.474582:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309858304 00000100:00100000:2.0:1788587006.474589:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309858304 00000100:00100000:2.0:1788587006.474623:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309858432 00000100:00100000:2.0:1788587006.474626:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309858432 00000100:00100000:2.0:1788587006.474637:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587006.474645:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf2712d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:6488:x1875469309858304:12345-0@lo:104: 00010000:00010000:2.0:1788587006.474657:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42044400/0x419e1ae1f634352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.474699:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587006.474704:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf2712d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:6488:x1875469309858304:12345-0@lo:104: Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.474710:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587006.474744:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587006.474749:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6488:x1875469309858432:12345-0@lo:104: 00010000:00010000:2.0:1788587006.474756:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42045e00/0x419e1ae1f6343513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.474778:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587006.474783:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6488:x1875469309858432:12345-0@lo:104: Request processed in 34us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.474788:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587006.474845:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309858304:0@lo:104: 00000100:00100000:2.0:1788587006.474852:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309858432:0@lo:104: 00010000:00010000:2.0:1788587006.474868:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475149:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587006.475156:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044400/0x419e1ae1f634352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475164:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587006.475169:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044400/0x419e1ae1f634352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475177:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044400/0x419e1ae1f634352f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587006.475196:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044400/0x419e1ae1f634352f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587006.475202:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587006.475238:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044400/0x419e1ae1f634352f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475244:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587006.475261:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044400/0x419e1ae1f634352f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475268:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044400/0x419e1ae1f634352f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343536 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475279:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587006.475283:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42045e00/0x419e1ae1f6343513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475287:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42045e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587006.475290:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42045e00/0x419e1ae1f6343513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475295:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42045e00/0x419e1ae1f6343513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587006.475301:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42045e00/0x419e1ae1f6343513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587006.475306:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587006.475339:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42045e00/0x419e1ae1f6343513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475345:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587006.475351:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42045e00/0x419e1ae1f6343513 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475358:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42045e00/0x419e1ae1f6343513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634351a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475370:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587006.475372:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587006.475373:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587006.475385:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309858560:0@lo:103: 00000100:00100000:3.0:1788587006.475420:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.475445:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587006.475451:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309858688:0@lo:103: 00000100:00100000:3.0:1788587006.475471:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.475498:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309858560 00000100:00100000:3.0:1788587006.475503:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309858560 00010000:00010000:3.0:1788587006.475524:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343536 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634352f expref: 17 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587006.475541:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309858688 00000100:00100000:3.0:1788587006.475544:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309858688 00010000:00010000:3.0:1788587006.475552:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634351a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 18 pid: 6467 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587006.475562:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587006.475568:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+18:3472:x1875469309858560:12345-0@lo:103: 00010000:00010000:3.0:1788587006.475585:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587006.475590:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343536 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634352f expref: 18 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475601:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634352f expref: 18 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475615:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634352f expref: 18 pid: 6464 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475626:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587006.475650:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+17:3472:x1875469309858560:12345-0@lo:103: Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.475656:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587006.475669:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587006.475674:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bace680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+16:3472:x1875469309858688:12345-0@lo:103: 00010000:00010000:3.0:1788587006.475680:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587006.475684:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634351a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 16 pid: 6467 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475692:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634351a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 16 pid: 6467 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475701:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634351a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343513 expref: 16 pid: 6467 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475711:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475719:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587006.475736:0:6457:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011161888s 00010000:00010000:3.0:1788587006.475741:0:6457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475749:0:6457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475755:0:6457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475761:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475767:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587006.475771:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475778:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475788:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587006.475822:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587006.475842:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bace680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+15:3472:x1875469309858688:12345-0@lo:103: Request processed in 168us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.475848:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587006.475879:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309858688:0@lo:103: 00000100:00100000:3.0:1788587006.475886:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309858560:0@lo:103: 00010000:00010000:2.0:1788587006.476275:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.476285:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587006.476297:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6343624 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587006.476370:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587006.484198:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+14:8097:x1875469309858176:12345-0@lo:253: Request processed in 63000us (63093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587006.484212:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788587006.484293:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:8097:1875469309858176:0@lo:253: 10000000:01000000:1.0:1788587006.484308:0:8097:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788587006.484311:0:8097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587006.484313:0:8097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587006.484314:0:8097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587006.484315:0:8097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587006.484316:0:8097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587006.484317:0:8097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587006.484319:0:8097:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587006.484320:0:8097:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788587006.484330:0:8097:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788587006.484331:0:8097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587006.484333:0:8097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788587006.484353:0:8097:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788587006.489310:0:8097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587006.489833:0:8097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587006.490256:0:8097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587006.490450:0:8097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587006.490689:0:8097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587006.491179:0:8097:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788587006.493471:0:8097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788587006.692060:0:8097:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788587006.692069:0:8097:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788587006.692122:0:8097:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788587006.692338:0:8097:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788587006.692452:0:8097:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788587006.692483:0:8097:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788587007.403039:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587007.531598:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309858816:0@lo:41: 00000100:00100000:3.0:1788587007.531675:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587007.532070:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309858816 00000100:00100000:1.0:1788587007.532079:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309858816 00000100:00100000:1.0:1788587007.532127:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587007.532136:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309858816:12345-0@lo:41: 00000004:00000024:1.0:1788587007.532176:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788587007.533061:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309858816:12345-0@lo:41: Request processed in 924us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587007.533070:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587007.533079:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309858816:0@lo:41: 00000100:00100000:0.0:1788587008.042978:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587008.043006:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309858944:0@lo:41: 00000100:00100000:0.0:1788587008.043074:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587008.043144:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309858944 00000100:00100000:0.0:1788587008.043152:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309858944 00000100:00100000:0.0:1788587008.043195:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587008.043203:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309858944:12345-0@lo:41: 00000004:00000024:0.0:1788587008.043258:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587008.043305:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309858944:12345-0@lo:41: Request processed in 101us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587008.043323:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587008.043371:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309858944:0@lo:41: 00010000:00010000:3.0:1788587008.428039:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587009.452699:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587010.474919:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587011.503276:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587011.632181:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309859072:0@lo:400: 00000100:00100000:2.0:1788587011.632252:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587011.632306:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309859584:0@lo:400: 00000100:00100000:2.0:1788587011.632333:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587011.632367:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788587011.632374:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309859200:0@lo:400: 00000100:00100000:2.0:1788587011.632402:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587011.632421:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309859712:0@lo:400: 00000100:00100000:2.0:1788587011.632441:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587011.632467:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309859328:0@lo:400: 00000100:00100000:2.0:1788587011.632488:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587011.632503:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309859840:0@lo:400: 00000100:00100000:2.0:1788587011.632525:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587011.632543:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587011.632548:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309859456:0@lo:400: 00000100:00100000:2.0:1788587011.632567:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587011.632599:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309859072 00000100:00100000:2.0:1788587011.632606:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309859072 00000100:00100000:2.0:1788587011.632652:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788587011.632659:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:3472:x1875469309859072:12345-0@lo:400: 00000100:00100000:2.0:1788587011.632720:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:3472:x1875469309859072:12345-0@lo:400: Request processed in 59us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.632727:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788587011.632760:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309859584 00000100:00100000:2.0:1788587011.632764:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309859584 00000100:00100000:2.0:1788587011.633162:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309859328 00000100:00100000:2.0:1788587011.633168:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309859328 00000100:00100000:2.0:1788587011.633189:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587011.633196:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309859584:12345-0@lo:400: 00000100:00100000:2.0:1788587011.633238:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309859584:12345-0@lo:400: Request processed in 43us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.633245:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587011.633257:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587011.633263:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309859328:12345-0@lo:400: 00000100:00100000:2.0:1788587011.633317:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309859328:12345-0@lo:400: Request processed in 55us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.633324:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587011.633340:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309859200 00000100:00100000:2.0:1788587011.633344:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309859200 00000100:00100000:2.0:1788587011.633363:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309859712 00000100:00100000:2.0:1788587011.633365:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309859712 00000100:00100000:2.0:1788587011.633386:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309859840 00000100:00100000:2.0:1788587011.633389:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309859840 00000100:00100000:2.0:1788587011.633400:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309859456 00000100:00100000:2.0:1788587011.633402:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309859456 00000100:00100000:2.0:1788587011.633413:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587011.633418:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309859200:12345-0@lo:400: 00000100:00100000:2.0:1788587011.633449:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309859200:12345-0@lo:400: Request processed in 30us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.633462:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587011.633475:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587011.633482:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309859712:12345-0@lo:400: 00000100:00100000:2.0:1788587011.633515:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309859712:12345-0@lo:400: Request processed in 34us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.633521:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587011.633531:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587011.633537:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309859840:12345-0@lo:400: 00000100:00100000:2.0:1788587011.633563:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309859840:12345-0@lo:400: Request processed in 27us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.633569:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587011.633580:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587011.633586:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309859456:12345-0@lo:400: 00000100:00100000:2.0:1788587011.633611:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309859456:12345-0@lo:400: Request processed in 26us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.633617:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788587011.633656:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372d500 x1875469309859200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587011.633670:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309859200:0@lo:400: 00010000:00080000:2.0:1788587011.633684:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372c380 x1875469309859712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587011.633693:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309859712:0@lo:400: 00000100:00100000:2.0:1788587011.633704:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309859072:0@lo:400: 00000100:00100000:2.0:1788587011.633714:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309859584:0@lo:400: 00010000:00080000:2.0:1788587011.633762:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372d880 x1875469309859456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587011.633771:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309859456:0@lo:400: 00000100:00100000:2.0:1788587011.635629:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309859328:0@lo:400: 00010000:00080000:2.0:1788587011.635657:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372ed80 x1875469309859840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587011.635668:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309859840:0@lo:400: 00000100:00080000:2.0:1788587011.635708:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587011.635713:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788587012.140152:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788587012.140159:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf04818800 from 30 10000000:01000000:0.0:1788587012.140163:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587012.140218:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.140230:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.140240:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587012.140264:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309859968:0@lo:101: 00000100:00100000:0.0:1788587012.140829:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587012.140873:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.141079:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309859968 00000100:00100000:1.0:1788587012.141087:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309859968 00000100:00100000:1.0:1788587012.141134:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788587012.141143:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+14:6469:x1875469309859968:12345-0@lo:101: 00010000:00010000:1.0:1788587012.141157:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587012.141171:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634362b expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.141193:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634362b expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.141204:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634362b expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.141213:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc000, rc 0) 00000100:00100000:1.0:1788587012.141256:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309859968:12345-0@lo:101: Request processed in 114us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.141273:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788587012.141774:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309859968:0@lo:101: 00010000:00010000:1.0:1788587012.141996:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.142009:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587012.142074:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860096:0@lo:501: 00000100:00100000:1.0:1788587012.142108:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.142134:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.142149:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309860096 00000100:00100000:1.0:1788587012.142153:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309860096 00000100:00100000:1.0:1788587012.142181:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788587012.142188:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309860096:12345-0@lo:501: 00000100:00100000:1.0:1788587012.142616:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309860096:12345-0@lo:501: Request processed in 426us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.142624:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788587012.142667:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860096:0@lo:501: 00000100:00100000:1.0:1788587012.142704:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860224:0@lo:503: 00000100:00100000:1.0:1788587012.142737:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.142754:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587012.144766:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309860224 00000100:00100000:2.0:1788587012.144776:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309860224 00000100:00100000:2.0:1788587012.144832:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788587012.144841:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309860224:12345-0@lo:503: 00000100:00100000:2.0:1788587012.145384:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309860224:12345-0@lo:503: Request processed in 542us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587012.145393:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788587012.146774:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860224:0@lo:503: 00000100:00100000:3.0:1788587012.148158:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8421:1875469309860352:0@lo:502: 00000100:00100000:3.0:1788587012.148229:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.148277:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309860352 00000100:00100000:3.0:1788587012.148282:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309860352 00000100:00100000:3.0:1788587012.148338:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587012.148348:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8421:x1875469309860352:12345-0@lo:502: 00000100:00100000:3.0:1788587012.149126:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:8421:x1875469309860352:12345-0@lo:502: Request processed in 775us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.149136:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587012.149192:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062dfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.149212:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8421:1875469309860352:0@lo:502: 00000100:00100000:3.0:1788587012.149261:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8421:1875469309860480:0@lo:502: 00000100:00100000:3.0:1788587012.149309:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.149468:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309860480 00000100:00100000:3.0:1788587012.149473:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309860480 00000100:00100000:3.0:1788587012.149502:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788587012.149628:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:8421:x1875469309860480:12345-0@lo:502: 00000100:00100000:3.0:1788587012.152095:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:8421:x1875469309860480:12345-0@lo:502: Request processed in 2581us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.152108:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788587012.152185:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062dfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.152218:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8421:1875469309860480:0@lo:502: 00000040:00080000:3.0:1788587012.152249:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788587012.153312:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788587012.153545:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587012.153556:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.153568:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587012.153578:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587012.153580:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf04818800 from 5 10000000:01000000:3.0:1788587012.153583:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587012.153618:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.153624:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.153635:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587012.153663:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860608:0@lo:101: 00000100:00100000:3.0:1788587012.153721:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.153754:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062dfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.153772:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309860608 00000100:00100000:3.0:1788587012.153777:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309860608 00000100:00100000:3.0:1788587012.153825:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788587012.153834:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309860608:12345-0@lo:101: 00010000:00010000:3.0:1788587012.153846:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587012.153862:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343639 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.153885:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.153895:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.153916:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482c00, rc 0) 00000100:00100000:3.0:1788587012.153949:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309860608:12345-0@lo:101: Request processed in 116us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.153955:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788587012.153994:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860608:0@lo:101: 00010000:00010000:3.0:1788587012.154006:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.154015:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587012.154056:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860736:0@lo:256: 00000100:00100000:3.0:1788587012.154085:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.154098:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062dfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.154110:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309860736 00000100:00100000:3.0:1788587012.154113:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309860736 00000100:00100000:3.0:1788587012.154134:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788587012.154140:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309860736:12345-0@lo:256: 20000000:01000000:3.0:1788587012.154152:0:6467:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788587012.154167:0:6467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788587012.154174:0:6467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788587012.154242:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309860736:12345-0@lo:256: Request processed in 102us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.154250:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788587012.154277:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860736:0@lo:256: 10000000:01000000:3.0:1788587012.154332:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587012.154338:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.154346:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587012.154352:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788587012.154354:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788587012.154357:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788587012.154378:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.154384:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.154391:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587012.154403:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860864:0@lo:101: 00000100:00100000:3.0:1788587012.154430:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.154458:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062dfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587012.154633:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309860864 00000100:00100000:0.0:1788587012.154638:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309860864 00000100:00100000:0.0:1788587012.154669:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788587012.154677:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309860864:12345-0@lo:101: 00010000:00010000:0.0:1788587012.154684:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587012.154695:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343647 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.154711:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.154720:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.154727:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482800, rc 0) 00000100:00100000:0.0:1788587012.154907:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309860864:12345-0@lo:101: Request processed in 230us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587012.154913:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788587012.154977:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860864:0@lo:101: 00010000:00010000:2.0:1788587012.154990:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587012.154998:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587012.155046:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860992:0@lo:501: 00000100:00100000:2.0:1788587012.155073:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.155145:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587012.155244:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309860992 00000100:00100000:0.0:1788587012.155249:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309860992 00000100:00100000:0.0:1788587012.155281:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788587012.155301:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309860992:12345-0@lo:501: 00000100:00100000:0.0:1788587012.155588:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309860992:12345-0@lo:501: Request processed in 287us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587012.155595:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788587012.155649:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309860992:0@lo:501: 00000100:00100000:2.0:1788587012.155684:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309861120:0@lo:503: 00000100:00100000:2.0:1788587012.155729:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.155776:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587012.155980:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309861120 00000100:00100000:0.0:1788587012.155985:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309861120 00000100:00100000:0.0:1788587012.156018:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788587012.156027:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309861120:12345-0@lo:503: 00000100:00100000:0.0:1788587012.156432:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309861120:12345-0@lo:503: Request processed in 406us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587012.156440:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788587012.156996:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309861120:0@lo:503: 00000100:00100000:2.0:1788587012.157458:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8422:1875469309861248:0@lo:502: 00000100:00100000:2.0:1788587012.157507:0:8422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.157575:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587012.157616:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309861248 00000100:00100000:0.0:1788587012.157622:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309861248 00000100:00100000:0.0:1788587012.157690:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788587012.157700:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:8422:x1875469309861248:12345-0@lo:502: 00000100:00100000:0.0:1788587012.158174:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:8422:x1875469309861248:12345-0@lo:502: Request processed in 468us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587012.158181:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587012.158322:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8422:1875469309861248:0@lo:502: 00000020:01000000:2.0:1788587012.158347:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587012.158353:0:8422:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1788587012.158359:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587012.158366:0:8422:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788587012.158371:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788587012.158374:0:8422:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:2.0:1788587012.158395:0:8422:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788587012.158397:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587012.158410:0:8422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8cbf41a33380) 00000020:00000080:2.0:1788587012.158428:0:8422:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788587012.158432:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788587012.158513:0:8422:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788587012.158519:0:8422:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788587012.158526:0:8422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f634365c 00010000:00080000:2.0:1788587012.158555:0:8422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf34096800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587012.158956:0:8422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788587012.237391:0:8422:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788587012.237424:0:8422:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788587012.238000:0:8422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587012.240752:0:8422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587012.240883:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788587012.241345:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788587012.244926:0:8431:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587012.244935:0:8431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788587012.248202:0:8422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788587012.248218:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788587012.248260:0:8422:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788587012.248292:0:8422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6343663 00000100:00080000:1.0:1788587012.248302:0:8422:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587012.248308:0:8422:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cbf34096800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587012.248343:0:8422:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41745c00 x1875469309861376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587012.248366:0:8422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788587012.248434:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587012.248438:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587012.248439:0:8422:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788587012.248442:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587012.248445:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587012.248447:0:8422:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587012.248449:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587012.248451:0:8422:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788587012.248475:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8422:1875469309861504:0@lo:502: 00000100:00100000:1.0:1788587012.248863:0:8422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.248906:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.248932:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469309861376:0@lo:8: 00000100:00100000:1.0:1788587012.248962:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.249097:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309861504 00000100:00100000:2.0:1788587012.249105:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309861504 00000100:00100000:3.0:1788587012.249108:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309861376 00000100:00100000:2.0:1788587012.249153:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788587012.249178:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309861376 00000100:00100000:3.0:1788587012.249205:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587012.249218:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3471:x1875469309861376:12345-0@lo:8: 00010000:00080000:3.0:1788587012.249244:0:8099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000100:00100000:2.0:1788587012.249263:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:8422:x1875469309861504:12345-0@lo:502: 00000020:00000080:3.0:1788587012.249269:0:8099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f634366a 00002000:00100000:3.0:1788587012.249312:0:8099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8cbe040c2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788587012.249317:0:8099:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788587012.249320:0:8099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788587012.249470:0:8099:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788587012.249689:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:8422:x1875469309861504:12345-0@lo:502: Request processed in 526us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587012.249696:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788587012.249788:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8422:1875469309861504:0@lo:502: 00000020:01000000:1.0:1788587012.249844:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587012.249850:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587012.249851:0:8422:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788587012.249856:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1788587012.250051:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788587012.250069:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788587012.250078:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587012.250088:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587012.250098:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788587012.250101:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf11802800 from 30 10000000:01000000:2.0:1788587012.250104:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788587012.250131:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587012.250138:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587012.250146:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587012.250240:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309861632:0@lo:101: 00000100:00100000:2.0:1788587012.250278:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1788587012.250324:0:8099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788587012.250350:0:8099:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587012.250352:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04a0d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.250407:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469309861376:12345-0@lo:8: Request processed in 1188us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.250416:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788587012.251100:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41745c00 x1875469309861376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587012.251111:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587012.251118:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788587012.251126:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587012.251130:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788587012.251133:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf34096800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788587012.251146:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587012.251151:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469309861376:0@lo:8: 00000100:00100000:2.0:1788587012.252668:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8432:1875469309861760:0@lo:700: 00000100:00100000:2.0:1788587012.252727:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.252754:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf2042b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.255083:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309861632 00000100:00100000:1.0:1788587012.255096:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309861632 00000100:00100000:1.0:1788587012.255161:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788587012.255178:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309861632:12345-0@lo:101: 00010000:00010000:1.0:1788587012.255194:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587012.255212:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343671 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.255242:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.255253:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.255261:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cce00, rc 0) 00000100:00100000:1.0:1788587012.255340:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309861632:12345-0@lo:101: Request processed in 164us (5061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.255347:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000004:00080000:1.0:1788587012.255385:0:8431:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788587012.255667:0:8431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 210004872554ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788587012.255700:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309861760 00000100:00100000:1.0:1788587012.255705:0:8108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309861760 00000100:00100000:1.0:1788587012.255742:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587012.255751:0:8108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8432:x1875469309861760:12345-0@lo:700: 00000100:00100000:1.0:1788587012.255814:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8108:1875469309861888:0@lo:700: 00000100:00100000:1.0:1788587012.255851:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.255876:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.255909:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309861632:0@lo:101: 00010000:00010000:1.0:1788587012.255933:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.255956:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587012.256011:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862016:0@lo:501: 00000100:00100000:1.0:1788587012.256038:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.256063:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104840 going to sleep for 11 seconds 00000100:00080000:1.0:1788587012.256092:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587012.256109:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309861888 00000100:00100000:1.0:1788587012.256112:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309861888 00000100:00100000:1.0:1788587012.256137:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587012.256143:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8108:x1875469309861888:12345-0@lo:700: 00000100:00100000:3.0:1788587012.256843:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309862016 00000100:00100000:3.0:1788587012.256849:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309862016 00000100:00100000:3.0:1788587012.256884:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788587012.256891:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309862016:12345-0@lo:501: 00000100:00100000:3.0:1788587012.257171:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309862016:12345-0@lo:501: Request processed in 280us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.257180:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788587012.260150:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862016:0@lo:501: 00000100:00100000:1.0:1788587012.260471:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862144:0@lo:503: 00000100:00100000:1.0:1788587012.260547:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.260582:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587012.260632:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309862144 00000100:00100000:2.0:1788587012.260640:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309862144 00000100:00100000:2.0:1788587012.260692:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788587012.260703:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309862144:12345-0@lo:503: 00000100:00100000:2.0:1788587012.260943:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309862144:12345-0@lo:503: Request processed in 240us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587012.260962:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788587012.263336:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862144:0@lo:503: 00000100:00100000:3.0:1788587012.267125:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8433:1875469309862272:0@lo:502: 00000100:00100000:3.0:1788587012.267217:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.267356:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309862272 00000100:00100000:2.0:1788587012.267365:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309862272 00000100:00100000:2.0:1788587012.267411:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587012.267421:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:8433:x1875469309862272:12345-0@lo:502: 00000100:00100000:2.0:1788587012.267825:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:8433:x1875469309862272:12345-0@lo:502: Request processed in 404us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587012.267834:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587012.267893:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062df480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587012.267917:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8433:1875469309862272:0@lo:502: 00000100:00100000:2.0:1788587012.267971:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8433:1875469309862400:0@lo:502: 00000100:00100000:2.0:1788587012.269104:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.269144:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03539600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.269304:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309862400 00000100:00100000:1.0:1788587012.269313:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309862400 00000100:00100000:1.0:1788587012.269365:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587012.269376:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:8433:x1875469309862400:12345-0@lo:502: 00000100:00100000:1.0:1788587012.269604:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:8433:x1875469309862400:12345-0@lo:502: Request processed in 230us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.269612:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788587012.269673:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8433:1875469309862400:0@lo:502: 00000040:00080000:2.0:1788587012.269701:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788587012.270001:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788587012.270020:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788587012.270035:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.270045:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587012.270054:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788587012.270057:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf11802800 from 5 10000000:01000000:1.0:1788587012.270059:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788587012.270086:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.270094:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.270103:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587012.270119:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862528:0@lo:101: 00000100:00100000:1.0:1788587012.270152:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.270434:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.271697:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309862528 00000100:00100000:1.0:1788587012.271707:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309862528 00000100:00100000:1.0:1788587012.271750:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587012.271760:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309862528:12345-0@lo:101: 00010000:00010000:1.0:1788587012.271772:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587012.271786:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634367f expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.271850:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634367f expref: 19 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.271870:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634367f expref: 19 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.271879:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd000, rc 0) 00000100:00100000:1.0:1788587012.271934:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309862528:12345-0@lo:101: Request processed in 175us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.271942:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587012.273191:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862528:0@lo:101: 00010000:00010000:1.0:1788587012.273215:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.273227:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587012.273296:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862656:0@lo:256: 00000100:00100000:1.0:1788587012.273346:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.273375:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.273392:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309862656 00000100:00100000:1.0:1788587012.273396:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309862656 00000100:00100000:1.0:1788587012.273426:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788587012.273433:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309862656:12345-0@lo:256: 20000000:01000000:1.0:1788587012.273450:0:6467:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788587012.273464:0:6467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788587012.273467:0:6467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788587012.273563:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309862656:12345-0@lo:256: Request processed in 129us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.273570:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788587012.273614:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862656:0@lo:256: 10000000:01000000:1.0:1788587012.273653:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587012.273662:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.273671:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587012.273679:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788587012.273682:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788587012.273685:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788587012.273708:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.273717:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.273726:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587012.273738:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862784:0@lo:101: 00000100:00100000:1.0:1788587012.273763:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.273780:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.273819:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309862784 00000100:00100000:1.0:1788587012.273823:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309862784 00000100:00100000:1.0:1788587012.273846:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788587012.273852:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309862784:12345-0@lo:101: 00010000:00010000:1.0:1788587012.273860:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587012.273873:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634368d expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.273900:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634368d expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.273910:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634368d expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.273941:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc800, rc 0) 00000100:00100000:1.0:1788587012.273973:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309862784:12345-0@lo:101: Request processed in 122us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.273979:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788587012.274013:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862784:0@lo:101: 00010000:00010000:1.0:1788587012.274024:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.274032:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587012.274077:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862912:0@lo:501: 00000100:00100000:1.0:1788587012.274100:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.274124:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.274138:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309862912 00000100:00100000:1.0:1788587012.274142:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309862912 00000100:00100000:1.0:1788587012.274164:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788587012.274170:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309862912:12345-0@lo:501: 00000100:00100000:1.0:1788587012.279658:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309862912:12345-0@lo:501: Request processed in 3987us (4055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.279675:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788587012.281693:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309862912:0@lo:501: 00000100:00100000:3.0:1788587012.281768:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309863040:0@lo:503: 00000100:00100000:3.0:1788587012.281862:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.281900:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf30484780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.282389:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309863040 00000100:00100000:1.0:1788587012.282397:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309863040 00000100:00100000:1.0:1788587012.282443:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788587012.282452:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309863040:12345-0@lo:503: 00000100:00100000:1.0:1788587012.284113:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309863040:12345-0@lo:503: Request processed in 1657us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.284125:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788587012.290439:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309863040:0@lo:503: 00000100:00100000:3.0:1788587012.291607:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8434:1875469309863168:0@lo:502: 00000100:00100000:3.0:1788587012.292405:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.292438:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062dfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.292987:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309863168 00000100:00100000:1.0:1788587012.292995:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309863168 00000100:00100000:1.0:1788587012.293093:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788587012.293103:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:8434:x1875469309863168:12345-0@lo:502: 00000100:00100000:1.0:1788587012.293470:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:8434:x1875469309863168:12345-0@lo:502: Request processed in 367us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.293478:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788587012.294035:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8434:1875469309863168:0@lo:502: 00000020:01000000:3.0:1788587012.294070:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587012.294078:0:8434:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788587012.294085:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587012.294088:0:8434:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788587012.294094:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587012.294098:0:8434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:3.0:1788587012.294120:0:8434:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788587012.294123:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587012.294168:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cbe044f3380) 00000020:00000080:3.0:1788587012.294192:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788587012.294209:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587012.294311:0:8434:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788587012.294317:0:8434:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788587012.294326:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63436a2 00010000:00080000:3.0:1788587012.294356:0:8434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe05879800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587012.294592:0:8434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:2.0:1788587012.305862:0:6479:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788587012.323946:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8108:x1875469309861888:12345-0@lo:700: Request processed in 67792us (68084us total) trans 0 rc 0/0 00010000:00080000:1.0:1788587012.323963:0:8108:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41745f80 x1875469309861888/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587012.323968:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587012.323984:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8108:1875469309861888:0@lo:700: 40000000:02000000:1.0:1788587012.323999:0:8108:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1788587012.373684:0:8434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788587012.373708:0:8434:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788587012.374199:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587012.374398:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587012.374461:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788587012.374518:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788587012.375684:0:8439:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587012.375690:0:8439:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788587012.378877:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587012.378894:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587012.378951:0:8434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788587012.378990:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f63436a9 00000100:00080000:3.0:1788587012.379003:0:8434:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587012.379009:0:8434:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbe05879800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587012.379050:0:8434:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3bacf800 x1875469309863296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587012.379076:0:8434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788587012.379144:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587012.379149:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587012.379151:0:8434:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788587012.379154:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587012.379158:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587012.379159:0:8434:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788587012.379162:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788587012.379164:0:8434:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788587012.379193:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8434:1875469309863424:0@lo:502: 00000100:00100000:3.0:1788587012.379278:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.379325:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf271046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.379410:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309863424 00000100:00100000:3.0:1788587012.379416:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309863424 00000100:00100000:3.0:1788587012.379454:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788587012.379463:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:8434:x1875469309863424:12345-0@lo:502: 00000100:00100000:3.0:1788587012.379704:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:8434:x1875469309863424:12345-0@lo:502: Request processed in 241us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.379712:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788587012.379757:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309863552:0@lo:400: 00000100:00100000:3.0:1788587012.379785:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.379826:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309864064:0@lo:400: 00000100:00100000:3.0:1788587012.379864:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.379894:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587012.379901:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309863936:0@lo:400: 00000100:00100000:3.0:1788587012.379924:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.379959:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309863680:0@lo:400: 00000100:00100000:3.0:1788587012.379993:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.380015:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587012.380023:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309863808:0@lo:400: 00000100:00100000:3.0:1788587012.380053:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.380091:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309863552 00000100:00100000:3.0:1788587012.380096:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309863552 00000100:00100000:3.0:1788587012.380123:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309864064 00000100:00100000:3.0:1788587012.380125:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309864064 00000100:00100000:3.0:1788587012.380136:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309863808 00000100:00100000:3.0:1788587012.380138:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309863808 00000100:00100000:3.0:1788587012.380149:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587012.380154:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309863552:12345-0@lo:400: 00000100:00100000:3.0:1788587012.380191:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309863552:12345-0@lo:400: Request processed in 37us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.380197:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587012.380209:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587012.380216:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309864064:12345-0@lo:400: 00000100:00100000:3.0:1788587012.380241:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309864064:12345-0@lo:400: Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.380247:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587012.380257:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587012.380262:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309863808:12345-0@lo:400: 00000100:00100000:3.0:1788587012.380316:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309863808:12345-0@lo:400: Request processed in 53us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.380322:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587012.380342:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309863936 00000100:00100000:3.0:1788587012.380345:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309863936 00000100:00100000:3.0:1788587012.380358:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309863680 00000100:00100000:3.0:1788587012.380361:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309863680 00000100:00100000:3.0:1788587012.380370:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587012.380375:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309863936:12345-0@lo:400: 00000100:00100000:3.0:1788587012.380404:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309863936:12345-0@lo:400: Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.380410:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587012.380419:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587012.380423:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309863680:12345-0@lo:400: 00000100:00100000:3.0:1788587012.380446:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309863680:12345-0@lo:400: Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.380451:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788587012.380523:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3bace300 x1875469309863808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587012.380537:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309863808:0@lo:400: 00000100:00100000:3.0:1788587012.380547:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309863680:0@lo:400: 00000100:00100000:3.0:1788587012.380576:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309863936:0@lo:400: 00010000:00080000:3.0:1788587012.380589:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3bacdf80 x1875469309863552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587012.380598:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309863552:0@lo:400: 00010000:00080000:3.0:1788587012.380617:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3bacd880 x1875469309864064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587012.380625:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309864064:0@lo:400: 00000100:00100000:3.0:1788587012.380653:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:8434:1875469309863424:0@lo:502: 00000020:01000000:3.0:1788587012.380678:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587012.380685:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587012.380687:0:8434:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788587012.380691:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788587012.380958:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788587012.380979:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788587012.380988:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.380998:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587012.381008:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788587012.381010:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbf053a99c0 from 1 10000000:01000000:3.0:1788587012.381013:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788587012.381042:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.381049:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.381058:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587012.381073:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309864192:0@lo:101: 00000004:00080000:0.0:1788587012.381077:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788587012.381112:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.381137:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe04b41b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.381150:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309864192 00000100:00100000:3.0:1788587012.381154:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309864192 00000100:00100000:3.0:1788587012.381178:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788587012.381185:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309864192:12345-0@lo:101: 00010000:00010000:3.0:1788587012.381193:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587012.381205:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63436b0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.381226:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.381238:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.381246:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01483200, rc 0) 00000100:00100000:3.0:1788587012.381277:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309864192:12345-0@lo:101: Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.381293:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788587012.381326:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309864192:0@lo:101: 00010000:00010000:3.0:1788587012.381338:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.381346:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587012.381383:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309864320:0@lo:501: 00000100:00100000:3.0:1788587012.381414:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.381429:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe04b41b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.381441:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309864320 00000100:00100000:3.0:1788587012.381444:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309864320 00000100:00100000:3.0:1788587012.381462:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788587012.381468:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309864320:12345-0@lo:501: 00000100:00100000:3.0:1788587012.381635:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309864320:12345-0@lo:501: Request processed in 166us (219us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587012.381642:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788587012.381669:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309864320:0@lo:501: 10000000:01000000:3.0:1788587012.381686:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788587012.381692:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.381698:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587012.387439:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309863296:0@lo:8: 00000100:00100000:1.0:1788587012.387540:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.387624:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309863296 00000100:00100000:1.0:1788587012.387631:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309863296 00000100:00100000:1.0:1788587012.387664:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587012.387671:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3471:x1875469309863296:12345-0@lo:8: 00010000:00080000:1.0:1788587012.387714:0:8101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1788587012.387744:0:8101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f63436be 00002000:00100000:1.0:1788587012.387764:0:8101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cbf41762000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788587012.387768:0:8101:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788587012.387771:0:8101:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587012.388077:0:8101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788587012.388105:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbf41760800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587012.388158:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469309863296:12345-0@lo:8: Request processed in 486us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.388166:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788587012.388204:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3bacf800 x1875469309863296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587012.388215:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587012.388222:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788587012.388229:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788587012.388235:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788587012.388237:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe05879800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788587012.388248:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788587012.388253:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309863296:0@lo:8: 00000004:00080000:3.0:1788587012.388654:0:8439:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788587012.388743:0:8439:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 210137948457ns, next at 0ns, rc = 0 00000001:00100000:0.0:1788587012.433127:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788587012.433263:0:8108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8432:x1875469309861760:12345-0@lo:700: Request processed in 177507us (180529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.433276:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788587012.433348:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372f100 x1875469309861760/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587012.433364:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8432:1875469309861760:0@lo:700: 00000004:00080000:2.0:1788587012.443595:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788587012.482905:0:8432:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788587012.482936:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8432:1875469309864576:0@lo:7: 00000100:00100000:0.0:1788587012.483004:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587012.483042:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10d4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587012.483066:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587012.483079:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309864448:0@lo:13: 00000100:00100000:0.0:1788587012.483106:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587012.483137:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309864576 00000100:00100000:0.0:1788587012.483144:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309864576 00000100:00100000:0.0:1788587012.483189:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587012.483198:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8432:x1875469309864576:12345-0@lo:7: 00000100:00100000:1.0:1788587012.483853:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309864448 00000100:00100000:1.0:1788587012.483860:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309864448 00000100:00100000:1.0:1788587012.483891:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587012.483898:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3473:x1875469309864448:12345-0@lo:13: 00002000:00000024:1.0:1788587012.483924:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788587012.483981:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3473:x1875469309864448:12345-0@lo:13: Request processed in 83us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.483988:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587012.484920:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1788587012.485249:0:8440:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788587012.485271:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8440:1875469309864832:0@lo:7: 00000100:00100000:2.0:1788587012.485343:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.485372:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a0d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.485716:0:8101:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587012.485723:0:8101:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788587012.486864:0:8100:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587012.486879:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309864832 00000100:00100000:1.0:1788587012.486886:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309864832 00000100:00080000:1.0:1788587012.486934:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788587012.491022:0:8099:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788587012.491031:0:8099:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788587012.491120:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8432:x1875469309864576:12345-0@lo:7: Request processed in 7919us (8111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587012.491130:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587012.491161:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587012.491172:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8440:x1875469309864832:12345-0@lo:7: 00010000:00080000:1.0:1788587012.491299:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3ab9e680 x1875469309864576/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587012.491315:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8432:1875469309864576:0@lo:7: 00000004:00080000:1.0:1788587012.491327:0:8432:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788587012.491366:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8432:1875469309864960:0@lo:5: 00000100:00100000:1.0:1788587012.491411:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.491437:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02eab240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.491454:0:8100:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587012.491461:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309864960 00000100:00100000:1.0:1788587012.491466:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309864960 00010000:00080000:1.0:1788587012.491862:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3ab9d500 x1875469309864448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587012.491880:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309864448:0@lo:13: 00000100:00100000:3.0:1788587012.492349:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309864704:0@lo:13: 00000100:00100000:3.0:1788587012.492402:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.492617:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587012.492628:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8432:x1875469309864960:12345-0@lo:5: 00002000:00080000:3.0:1788587012.492654:0:8449:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788587012.492696:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8432:x1875469309864960:12345-0@lo:5: Request processed in 71us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.492710:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788587012.492744:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41745c00 x1875469309864960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587012.492752:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309864704 00000100:00100000:1.0:1788587012.492755:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8432:1875469309864960:0@lo:5: 00000100:00100000:2.0:1788587012.492757:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309864704 00000004:00080000:1.0:1788587012.492765:0:8432:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788587012.492809:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587012.492817:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3472:x1875469309864704:12345-0@lo:13: 00000100:00100000:1.0:1788587012.492818:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8432:1875469309865088:0@lo:5: 00002000:00000024:2.0:1788587012.492829:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788587012.492842:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587012.492859:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02eab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587012.492867:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3472:x1875469309864704:12345-0@lo:13: Request processed in 51us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.492870:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309865088 00000100:00100000:2.0:1788587012.492873:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587012.492873:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309865088 00000100:00100000:1.0:1788587012.492893:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587012.492900:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8432:x1875469309865088:12345-0@lo:5: 00002000:00080000:1.0:1788587012.492927:0:8100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:3.0:1788587012.492941:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372df80 x1875469309864704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587012.492953:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309864704:0@lo:13: 00000100:00100000:1.0:1788587012.496998:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8432:x1875469309865088:12345-0@lo:5: Request processed in 4092us (4148us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788587012.497021:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788587012.497339:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf35d56680 x1875469309865088/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587012.497355:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8432:1875469309865088:0@lo:5: 00000004:00080000:2.0:1788587012.497370:0:8432:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788587012.497406:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8432:1875469309865216:0@lo:900: 00000100:00100000:2.0:1788587012.497439:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.497469:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a0d3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.497530:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309865216 00000100:00100000:3.0:1788587012.497537:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309865216 00000100:00100000:3.0:1788587012.497578:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587012.497586:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8432:x1875469309865216:12345-0@lo:900: 00000100:00100000:3.0:1788587012.497638:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8432:x1875469309865216:12345-0@lo:900: Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.497644:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788587012.497762:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372d500 x1875469309865216/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587012.497772:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8432:1875469309865216:0@lo:900: 00002000:00080000:0.0:1788587012.498066:0:8099:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788587012.498071:0:8099:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788587012.498152:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8440:x1875469309864832:12345-0@lo:7: Request processed in 6982us (12807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587012.498159:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788587012.498210:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372ca80 x1875469309864832/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587012.498220:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8440:1875469309864832:0@lo:7: 00000004:00080000:2.0:1788587012.498229:0:8440:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788587012.498253:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8440:1875469309865344:0@lo:5: 00000100:00100000:2.0:1788587012.498277:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.498340:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a0d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.498370:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309865344 00000100:00100000:3.0:1788587012.498375:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309865344 00000100:00100000:3.0:1788587012.498433:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587012.498442:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8440:x1875469309865344:12345-0@lo:5: 00002000:00080000:3.0:1788587012.498461:0:8449:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788587012.498464:0:8449:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788587012.498716:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8440:x1875469309865344:12345-0@lo:5: Request processed in 275us (436us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788587012.498723:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788587012.498863:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372ca80 x1875469309865344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587012.498874:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8440:1875469309865344:0@lo:5: 00000004:00080000:2.0:1788587012.498883:0:8440:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788587012.498910:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8440:1875469309865472:0@lo:700: 00000100:00100000:2.0:1788587012.498935:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587012.498963:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a0d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587012.498970:0:8109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309865472 00000100:00100000:1.0:1788587012.498975:0:8109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309865472 00000100:00100000:2.0:1788587012.499027:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587012.499036:0:8108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8440:x1875469309865472:12345-0@lo:700: 00010000:00010000:2.0:1788587012.524459:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788587012.586826:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788587012.586857:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788587012.586864:0:8108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8440:x1875469309865472:12345-0@lo:700: Request processed in 87823us (87920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587012.586878:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587012.586890:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372fb80 x1875469309865472/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00080000:1.0:1788587012.586945:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1788587012.586982:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8440:1875469309865472:0@lo:700: 00000100:00100000:3.0:1788587012.653990:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587012.654329:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309865600:0@lo:41: 00000100:00100000:3.0:1788587012.654450:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587012.654724:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309865600 00000100:00100000:0.0:1788587012.654733:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309865600 00000100:00100000:0.0:1788587012.654779:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587012.654788:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309865600:12345-0@lo:41: 00000004:00000024:0.0:1788587012.654847:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587012.655874:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309865600:12345-0@lo:41: Request processed in 1081us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587012.655886:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587012.658675:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309865600:0@lo:41: 00000004:02000040:3.0:1788587012.665429:0:8440:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788587012.674148:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8440:1875469309865728:0@lo:5: 00000100:00100000:3.0:1788587012.674214:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.674265:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe04b41cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587012.674328:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309865728 00000100:00100000:2.0:1788587012.674336:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309865728 00000100:00100000:2.0:1788587012.674395:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587012.674406:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8440:x1875469309865728:12345-0@lo:5: 00002000:00080000:2.0:1788587012.682632:0:8101:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788587012.682655:0:8101:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788587012.686609:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8440:x1875469309865728:12345-0@lo:5: Request processed in 12197us (12386us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788587012.686622:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788587012.687385:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586ca80 x1875469309865728/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587028 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587012.687402:0:8440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788587012.687419:0:8440:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbe0586ca80 x1875469309865728/t4294967299(4294967299) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587028 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587012.687431:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8440:1875469309865728:0@lo:5: 00000004:00080000:1.0:1788587012.687448:0:8440:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:02000400:3.0:1788587012.845454:0:8481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788587013.169904:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587013.169937:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309865856:0@lo:41: 00000100:00100000:0.0:1788587013.170003:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587013.170154:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309865856 00000100:00100000:2.0:1788587013.170163:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309865856 00000100:00100000:2.0:1788587013.170221:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587013.170230:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309865856:12345-0@lo:41: 00000004:00000024:2.0:1788587013.170268:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587013.171198:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309865856:12345-0@lo:41: Request processed in 965us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.171205:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309865856:0@lo:41: 00000100:00100000:2.0:1788587013.171210:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1788587013.550460:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587014.571960:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587015.599351:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587016.618935:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788587017.398110:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788587017.643307:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587017.773993:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309865984:0@lo:13: 00000100:00100000:3.0:1788587017.774062:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774196:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309866496:0@lo:400: 00000100:00100000:3.0:1788587017.774226:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774243:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309867008:0@lo:400: 00000100:00100000:3.0:1788587017.774282:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774309:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788587017.774315:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309866112:0@lo:400: 00000100:00100000:3.0:1788587017.774341:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774359:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309866624:0@lo:400: 00000100:00100000:3.0:1788587017.774377:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774391:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309867136:0@lo:400: 00000100:00100000:3.0:1788587017.774406:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774437:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309866240:0@lo:400: 00000100:00100000:3.0:1788587017.774457:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774472:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309866752:0@lo:400: 00000100:00100000:3.0:1788587017.774490:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774505:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788587017.774509:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309866368:0@lo:400: 00000100:00100000:3.0:1788587017.774543:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774559:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309866880:0@lo:400: 00000100:00100000:3.0:1788587017.774576:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.774602:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309866496 00000100:00100000:3.0:1788587017.774609:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309866496 00000100:00100000:3.0:1788587017.774642:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309866240 00000100:00100000:3.0:1788587017.774644:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309866240 00000100:00100000:2.0:1788587017.774651:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309865984 00000100:00100000:2.0:1788587017.774658:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309865984 00000100:00100000:3.0:1788587017.774659:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309866752 00000100:00100000:3.0:1788587017.774664:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309866752 00000100:00100000:3.0:1788587017.774693:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309866880 00000100:00100000:3.0:1788587017.774696:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309866880 00000100:00100000:2.0:1788587017.774712:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587017.774719:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587017.774725:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309865984:12345-0@lo:13: 00000100:00100000:3.0:1788587017.774731:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309866496:12345-0@lo:400: 00002000:00000024:2.0:1788587017.774761:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587017.774784:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309866496:12345-0@lo:400: Request processed in 57us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.774824:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309865984:12345-0@lo:13: Request processed in 102us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.774831:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587017.774852:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309866624 00000100:00100000:2.0:1788587017.774856:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309866624 00000100:00100000:2.0:1788587017.774871:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309866368 00000100:00100000:2.0:1788587017.774874:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309866368 00000100:00100000:2.0:1788587017.774885:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587017.774891:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309866624:12345-0@lo:400: 00000100:00100000:2.0:1788587017.774922:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309866624:12345-0@lo:400: Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.774928:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587017.774942:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587017.774946:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587017.774951:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3baced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309866368:12345-0@lo:400: 00000100:00100000:3.0:1788587017.774969:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587017.774978:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309866240:12345-0@lo:400: 00000100:00100000:2.0:1788587017.774989:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3baced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309866368:12345-0@lo:400: Request processed in 39us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.774996:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788587017.775017:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587017.775019:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309866240:12345-0@lo:400: Request processed in 42us (559us total) trans 0 rc 0/0 00000100:00080000:2.0:1788587017.775023:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587017.775027:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587017.775031:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587017.775163:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309867008 00000100:00100000:0.0:1788587017.775168:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309867008 00000100:00100000:0.0:1788587017.775227:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309867136 00000100:00100000:0.0:1788587017.775230:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309867136 00000100:00100000:3.0:1788587017.775503:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587017.775887:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587017.776194:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309866368:0@lo:400: 00010000:00080000:2.0:1788587017.776229:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586ed80 x1875469309866240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587017.776262:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309866240:0@lo:400: 00000100:00080000:2.0:1788587017.776292:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587017.776582:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587017.776597:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309867008:12345-0@lo:400: 00000100:00100000:1.0:1788587017.776632:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309867264:0@lo:41: 00000100:00100000:0.0:1788587017.776661:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309867008:12345-0@lo:400: Request processed in 68us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587017.776682:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587017.776686:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587017.776697:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309867136:12345-0@lo:400: 00000100:00100000:2.0:1788587017.776735:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309867136:12345-0@lo:400: Request processed in 41us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.776740:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587017.776819:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309867264 00000100:00100000:2.0:1788587017.776824:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309867264 00000100:00100000:2.0:1788587017.776854:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587017.776860:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309867264:12345-0@lo:41: 00000004:00000024:2.0:1788587017.776890:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788587017.776926:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309867264:12345-0@lo:41: Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.776932:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587017.776984:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587017.780360:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309866752:12345-0@lo:400: 00000100:00100000:3.0:1788587017.780643:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309866752:12345-0@lo:400: Request processed in 5130us (6149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587017.780655:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587017.780689:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788587017.780703:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309866880:12345-0@lo:400: 00000100:00100000:2.0:1788587017.780902:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309867392:0@lo:13: 00000100:00100000:3.0:1788587017.780906:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309866880:12345-0@lo:400: Request processed in 206us (6326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587017.780914:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587017.780952:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.780970:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309866624:0@lo:400: 00010000:00080000:3.0:1788587017.780989:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586ce00 x1875469309867136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587017.780999:0:3472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788587017.781011:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309867264:0@lo:41: 00000100:00100000:3.0:1788587017.781017:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309867136:0@lo:400: 00010000:00080000:3.0:1788587017.781033:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586df80 x1875469309865984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587017.781048:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309867392 00000100:00100000:3.0:1788587017.781049:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309865984:0@lo:13: 00000100:00100000:2.0:1788587017.781058:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309867392 00010000:00080000:3.0:1788587017.781066:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586e300 x1875469309866496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587017.781074:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309866496:0@lo:400: 00000100:00100000:2.0:1788587017.781096:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587017.781104:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309867392:12345-0@lo:13: 00002000:00000024:2.0:1788587017.781119:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587017.781158:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309867392:12345-0@lo:13: Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.781174:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587017.781229:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309866112 00010000:00080000:3.0:1788587017.781233:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586d880 x1875469309867008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587017.781236:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309866112 00000100:00100000:3.0:1788587017.781245:0:3472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788587017.781271:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309867008:0@lo:400: 00000100:00100000:0.0:1788587017.781284:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788587017.781292:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:3472:x1875469309866112:12345-0@lo:400: 00000100:00100000:0.0:1788587017.781338:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:3472:x1875469309866112:12345-0@lo:400: Request processed in 48us (6995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587017.781344:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788587017.781430:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309866112:0@lo:400: 00010000:00080000:2.0:1788587017.783337:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586f480 x1875469309866880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587017.783359:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309866880:0@lo:400: 00010000:00080000:2.0:1788587017.783373:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586f100 x1875469309866752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587017.783381:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309866752:0@lo:400: 00010000:00080000:2.0:1788587017.783420:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372fb80 x1875469309867392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587017.783434:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309867392:0@lo:13: 00000100:00100000:3.0:1788587018.287319:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309867520:0@lo:41: 00000100:00100000:3.0:1788587018.287409:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587018.290182:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309867520 00000100:00100000:3.0:1788587018.290196:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309867520 00000100:00100000:3.0:1788587018.290264:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587018.290274:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309867520:12345-0@lo:41: 00000004:00000024:3.0:1788587018.290312:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587018.290390:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309867520:12345-0@lo:41: Request processed in 117us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587018.290397:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587018.290452:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309867520:0@lo:41: 00010000:00010000:2.0:1788587018.673947:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587019.691981:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587020.721662:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587021.739920:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587022.762958:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587022.893228:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309867648:0@lo:13: 00000100:00100000:2.0:1788587022.893472:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309867776:0@lo:13: 00000100:00100000:2.0:1788587022.893510:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.893562:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309868288:0@lo:400: 00000100:00100000:2.0:1788587022.893586:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.893603:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309868800:0@lo:400: 00000100:00100000:2.0:1788587022.893624:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.893650:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788587022.893656:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309867904:0@lo:400: 00000100:00100000:2.0:1788587022.893685:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.893705:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309868416:0@lo:400: 00000100:00100000:2.0:1788587022.893726:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.893757:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309868928:0@lo:400: 00000100:00100000:2.0:1788587022.893777:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.893825:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309867776 00000100:00100000:2.0:1788587022.893832:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309867776 00000100:00100000:2.0:1788587022.893882:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587022.893891:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309867776:12345-0@lo:13: 00002000:00000024:2.0:1788587022.893923:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587022.893965:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309867776:12345-0@lo:13: Request processed in 75us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.893972:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587022.893995:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309868800 00000100:00100000:2.0:1788587022.893999:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309868800 00000100:00100000:2.0:1788587022.894021:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309868928 00000100:00100000:2.0:1788587022.894024:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309868928 00000100:00100000:2.0:1788587022.894039:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587022.894046:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309868800:12345-0@lo:400: 00000100:00100000:2.0:1788587022.894077:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309868800:12345-0@lo:400: Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.894083:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587022.894095:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587022.894101:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309868928:12345-0@lo:400: 00000100:00100000:2.0:1788587022.894126:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309868928:12345-0@lo:400: Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.894131:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788587022.894146:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788587022.894176:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586df80 x1875469309868928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587022.894189:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309868928:0@lo:400: 00010000:00080000:2.0:1788587022.894207:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372f100 x1875469309867776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587022.894231:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309867776:0@lo:13: 00010000:00080000:2.0:1788587022.894241:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586e300 x1875469309868800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587022.894249:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309868800:0@lo:400: 00000100:00100000:3.0:1788587022.894834:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587022.894867:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309868160:0@lo:400: 00000100:00100000:3.0:1788587022.894897:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587022.894915:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309868672:0@lo:400: 00000100:00100000:3.0:1788587022.894937:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587022.894955:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788587022.894961:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309868032:0@lo:400: 00000100:00100000:3.0:1788587022.894981:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587022.894998:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309868544:0@lo:400: 00000100:00100000:3.0:1788587022.895016:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587022.895055:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309868288 00000100:00100000:3.0:1788587022.895060:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309868288 00000100:00100000:3.0:1788587022.895085:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309868672 00000100:00100000:3.0:1788587022.895089:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309868672 00000100:00100000:3.0:1788587022.895110:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309868032 00000100:00100000:3.0:1788587022.895113:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309868032 00000100:00100000:3.0:1788587022.895123:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309868544 00000100:00100000:3.0:1788587022.895125:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309868544 00000100:00100000:3.0:1788587022.895137:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587022.895144:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309868288:12345-0@lo:400: 00000100:00100000:3.0:1788587022.895195:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309868288:12345-0@lo:400: Request processed in 51us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587022.895202:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587022.895233:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587022.895240:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309868672:12345-0@lo:400: 00000100:00100000:3.0:1788587022.895272:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309868672:12345-0@lo:400: Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587022.895277:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587022.895426:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309867648 00000100:00100000:0.0:1788587022.895442:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309867648 00000100:00100000:0.0:1788587022.895472:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587022.895478:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309867648:12345-0@lo:13: 00002000:00000024:0.0:1788587022.895493:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587022.895524:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309867648:12345-0@lo:13: Request processed in 47us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587022.895530:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587022.895839:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587022.895849:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309868032:12345-0@lo:400: 00000100:00100000:2.0:1788587022.895884:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309868032:12345-0@lo:400: Request processed in 38us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.895891:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587022.895906:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587022.895912:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309868544:12345-0@lo:400: 00000100:00100000:2.0:1788587022.895937:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309868544:12345-0@lo:400: Request processed in 26us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.895942:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587022.895962:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309868416 00000100:00100000:2.0:1788587022.895966:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309868416 00000100:00100000:2.0:1788587022.895982:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309868160 00000100:00100000:2.0:1788587022.895985:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309868160 00000100:00100000:2.0:1788587022.895997:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587022.896002:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309868416:12345-0@lo:400: 00000100:00100000:2.0:1788587022.896032:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309868416:12345-0@lo:400: Request processed in 29us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.896038:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587022.896060:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587022.896066:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309868160:12345-0@lo:400: 00000100:00100000:2.0:1788587022.896095:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309868160:12345-0@lo:400: Request processed in 29us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.896100:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587022.896120:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309867904 00000100:00100000:2.0:1788587022.896124:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309867904 00000100:00100000:2.0:1788587022.896157:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788587022.896164:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:3474:x1875469309867904:12345-0@lo:400: 00000100:00100000:2.0:1788587022.896194:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:3474:x1875469309867904:12345-0@lo:400: Request processed in 31us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.896200:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1788587022.896507:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0372fb80 x1875469309868032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587022.896522:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309868032:0@lo:400: 00010000:00080000:3.0:1788587022.896536:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586c380 x1875469309868544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587022.896544:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309868544:0@lo:400: 00000100:00100000:3.0:1788587022.896555:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309868160:0@lo:400: 00010000:00080000:3.0:1788587022.896565:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586d880 x1875469309868672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587022.896573:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309868672:0@lo:400: 00010000:00080000:3.0:1788587022.896583:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3ab9d500 x1875469309867648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587022.896601:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309867648:0@lo:13: 00000100:00100000:3.0:1788587022.896629:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587022.896638:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309869056:0@lo:41: 00000100:00100000:3.0:1788587022.896678:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788587022.896708:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587022.896713:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587022.896731:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309867904:0@lo:400: 00000100:00100000:3.0:1788587022.896743:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309868416:0@lo:400: 00010000:00080000:3.0:1788587022.896754:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586f100 x1875469309868288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587022.896761:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309868288:0@lo:400: 00000100:00100000:2.0:1788587022.898738:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309869056 00000100:00100000:2.0:1788587022.898753:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309869056 00000100:00100000:2.0:1788587022.898824:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587022.898834:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309869056:12345-0@lo:41: 00000004:00000024:2.0:1788587022.898876:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788587022.898950:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309869056:12345-0@lo:41: Request processed in 117us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.898957:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788587022.899070:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309869056:0@lo:41: 00000020:01000004:3.0:1788587023.130031:0:9052:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587023.130035:0:9052:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788587023.130176:0:9052:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe040c5800 00000020:01000004:3.0:1788587023.130191:0:9052:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788587023.130205:0:9052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788587023.130569:0:9052:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cbe044f19c0) 00000020:00000080:3.0:1788587023.130592:0:9052:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788587023.152085:0:9052:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788587023.152792:0:9052:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788587023.176966:0:9052:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788587023.183319:0:9052:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788587023.183356:0:9052:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788587023.183412:0:9052:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788587023.183575:0:9052:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788587023.184128:0:9052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788587023.184143:0:9052:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788587023.184154:0:9052:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x419e1ae1f63436cc 00000020:01000004:3.0:1788587023.184162:0:9052:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788587023.184184:0:9052:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788587023.184188:0:9052:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788587023.184199:0:9052:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788587023.184241:0:9052:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788587023.184245:0:9052:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788587023.207778:0:9052:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788587023.207855:0:9052:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.114@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788587023.207859:0:9052:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788587023.207860:0:9052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587023.207862:0:9052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587023.207863:0:9052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587023.207864:0:9052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587023.207865:0:9052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587023.207867:0:9052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587023.207868:0:9052:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587023.207870:0:9052:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587023.207871:0:9052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587023.207872:0:9052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587023.207876:0:9052:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788587023.207878:0:9052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587023.207880:0:9052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587023.207881:0:9052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587023.207882:0:9052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587023.207883:0:9052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587023.207884:0:9052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587023.207885:0:9052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587023.207886:0:9052:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587023.207888:0:9052:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587023.207888:0:9052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587023.207890:0:9052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587023.207917:0:9052:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788587023.207935:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309869184:0@lo:253: 00000100:00100000:3.0:1788587023.208003:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.208111:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270eae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.210495:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309869184 00000100:00100000:0.0:1788587023.210511:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309869184 00000100:00100000:0.0:1788587023.210630:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788587023.210641:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:9052:x1875469309869184:12345-0@lo:253: 20000000:01000000:0.0:1788587023.210679:0:6467:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788587023.210683:0:6467:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788587023.210690:0:6467:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788587023.210693:0:6467:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788587023.213546:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587023.213784:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788587023.213824:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788587023.213870:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788587023.213879:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788587023.213917:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788587023.213969:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788587023.214968:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788587023.214999:0:6467:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:0.0:1788587023.215001:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788587023.215052:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788587023.215129:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788587023.215185:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788587023.215482:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:0.0:1788587023.215525:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788587023.215535:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788587023.215566:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788587023.215617:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788587023.216275:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788587023.216295:0:6467:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:0.0:1788587023.216516:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788587023.216566:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788587023.216583:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788587023.216637:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788587023.216645:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:0.0:1788587023.216677:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788587023.216686:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788587023.216718:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788587023.216769:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788587023.218015:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788587023.218040:0:6467:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:0.0:1788587023.218042:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788587023.218154:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788587023.218163:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788587023.218191:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788587023.218207:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:0.0:1788587023.218248:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788587023.218257:0:6467:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788587023.218608:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788587023.218654:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788587023.218672:0:6467:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788587023.218675:0:6467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788587023.218681:0:6467:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788587023.218682:0:6467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788587023.218685:0:6467:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788587023.218696:0:6467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788587023.218699:0:6467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788587023.218737:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788587023.218740:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788587023.219902:0:9054:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788587023.219964:0:9054:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788587023.220026:0:9054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788587023.220415:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788587023.220479:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788587023.220569:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788587023.220588:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788587023.220595:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788587023.221235:0:9055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788587023.221488:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788587023.221532:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788587023.221597:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788587023.221613:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788587023.221615:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788587023.224121:0:9056:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788587023.224258:0:9056:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788587023.224291:0:9056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788587023.224928:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788587023.224980:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788587023.225063:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788587023.225082:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788587023.225086:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788587023.232098:0:9057:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788587023.232322:0:9057:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788587023.233498:0:9057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788587023.243979:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788587023.244047:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788587023.244122:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788587023.244252:0:6467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788587023.244255:0:6467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788587023.251670:0:9058:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788587023.251769:0:9058:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788587023.251866:0:9058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788587023.252559:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788587023.252643:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788587023.252684:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:3.0:1788587023.252907:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788587023.252926:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.252945:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 21 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.252953:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.252959:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634362b expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.252966:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 21 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.252981:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.252987:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634368d expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.252994:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253001:0:6467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253037:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253051:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 21 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.253064:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869312:0@lo:104: 00000100:00100000:3.0:1788587023.253137:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.253176:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309869312 00000100:00100000:0.0:1788587023.253186:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309869312 00010000:00010000:3.0:1788587023.253192:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634368d expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253201:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634368d expref: 21 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.253219:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a16a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869440:0@lo:104: 00000100:00100000:3.0:1788587023.253245:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.253249:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587023.253262:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:6467:x1875469309869312:12345-0@lo:104: 00010000:00010000:0.0:1788587023.253276:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253280:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253295:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 21 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.253304:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a14700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869568:0@lo:104: 00000100:00100000:1.0:1788587023.253459:0:6456:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788587023.253466:0:6456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788587023.253644:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587023.253664:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 21 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253672:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 21 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.253680:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869696:0@lo:104: 00000100:00100000:3.0:1788587023.253780:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587023.253827:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634362b expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253835:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634362b expref: 21 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.253843:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a14a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869824:0@lo:104: 00000100:00100000:3.0:1788587023.253865:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587023.253896:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253904:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 21 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.253912:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869952:0@lo:104: 00000100:00100000:3.0:1788587023.253942:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587023.253960:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 21 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.253968:0:6467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 21 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.253977:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309870080:0@lo:104: 00000100:00100000:3.0:1788587023.253995:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf41799c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788587023.254124:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587023.254133:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:6467:x1875469309869312:12345-0@lo:104: Request processed in 874us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.254141:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587023.254168:0:6455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788587023.254183:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.254193:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309869440 00000100:00100000:0.0:1788587023.254197:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309869440 00000100:00100000:0.0:1788587023.254226:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309869568 00000100:00100000:0.0:1788587023.254229:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309869568 00000100:00100000:0.0:1788587023.254238:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309869696 00000100:00100000:0.0:1788587023.254240:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309869696 00000100:00100000:0.0:1788587023.254248:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309869824 00000100:00100000:0.0:1788587023.254250:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309869824 00000100:00100000:0.0:1788587023.254257:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309869952 00000100:00100000:0.0:1788587023.254259:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309869952 00000100:00100000:0.0:1788587023.254266:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309870080 00000100:00100000:0.0:1788587023.254269:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309870080 00000100:00100000:0.0:1788587023.254280:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587023.254286:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+8:6467:x1875469309869440:12345-0@lo:104: 00010000:00010000:0.0:1788587023.254295:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.254361:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788587023.254366:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+8:6467:x1875469309869440:12345-0@lo:104: Request processed in 81us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.254372:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587023.254384:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587023.254389:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+7:6467:x1875469309869568:12345-0@lo:104: 00010000:00010000:0.0:1788587023.254397:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.254425:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788587023.255112:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+7:6467:x1875469309869568:12345-0@lo:104: Request processed in 722us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.255119:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587023.255137:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587023.255146:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+6:6467:x1875469309869696:12345-0@lo:104: 00010000:00010000:0.0:1788587023.255155:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.255200:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788587023.255206:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+6:6467:x1875469309869696:12345-0@lo:104: Request processed in 62us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.255222:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587023.255234:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587023.255240:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+5:6467:x1875469309869824:12345-0@lo:104: 00010000:00010000:0.0:1788587023.255247:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.255282:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788587023.255286:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+5:6467:x1875469309869824:12345-0@lo:104: Request processed in 47us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.255291:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587023.255316:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587023.255322:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe040bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:6467:x1875469309869952:12345-0@lo:104: 00010000:00010000:0.0:1788587023.255329:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.255353:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788587023.255358:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe040bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:6467:x1875469309869952:12345-0@lo:104: Request processed in 37us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.255363:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587023.255393:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587023.255400:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:6467:x1875469309870080:12345-0@lo:104: 00010000:00010000:0.0:1788587023.255407:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.256563:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788587023.256720:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:6467:x1875469309870080:12345-0@lo:104: Request processed in 1318us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.256729:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788587023.256790:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788587023.256814:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.256822:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587023.256839:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.256848:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587023.256855:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587023.256860:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587023.256901:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.256909:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587023.256929:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.256937:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f63436b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63436b7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257080:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788587023.257084:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257090:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587023.257093:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257099:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587023.257116:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587023.257122:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587023.257137:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257142:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587023.257163:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257169:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd400/0x419e1ae1f634368d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343694 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257181:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788587023.257184:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257190:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587023.257192:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257199:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587023.257204:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587023.257218:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587023.257240:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257247:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587023.257252:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257259:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6343671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343678 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257269:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788587023.257272:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257278:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587023.257281:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257288:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587023.257293:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.257395:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869312:0@lo:104: 00000100:00100000:3.0:1788587023.257409:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a16a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869440:0@lo:104: 00000100:00100000:3.0:1788587023.257418:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a14700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869568:0@lo:104: 00000100:00100000:3.0:1788587023.257572:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869696:0@lo:104: 00000100:00100000:3.0:1788587023.257581:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a14a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869824:0@lo:104: 00000100:00100000:3.0:1788587023.257589:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309869952:0@lo:104: 00000100:00100000:3.0:1788587023.257596:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6467:1875469309870080:0@lo:104: 00010000:00010000:3.0:1788587023.257631:0:6467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587023.257736:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587023.257765:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257772:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587023.257779:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257821:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f6343647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634364e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257834:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788587023.257838:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257840:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587023.257848:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc1cf1c20) 00010000:00010000:1.0:1788587023.257851:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587023.257853:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257870:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483800 already unused, calling callback (ffffffffc1cf1c20) 00010000:00010000:0.0:1788587023.257872:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587023.257875:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587023.257890:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257892:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587023.257904:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1788587023.257908:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587023.257915:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587023.257922:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.257931:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587023.257936:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257948:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257956:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587023.257961:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257967:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01483800/0x419e1ae1f63435ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435f3 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257978:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587023.257980:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257985:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587023.257988:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.257994:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587023.257999:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587023.258003:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587023.258013:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.258019:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587023.258022:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.258037:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483200/0x419e1ae1f63435c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435c9 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.258047:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587023.258048:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587023.258050:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587023.258055:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587023.258362:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f634362b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343632 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.258381:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587023.258388:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587023.258390:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587023.258409:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309870208:0@lo:103: 00000100:00100000:0.0:1788587023.258541:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.258586:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309870464:0@lo:103: 00000100:00100000:2.0:1788587023.258619:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.258781:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309870976:0@lo:103: 00000100:00100000:2.0:1788587023.258822:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.258902:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309870720:0@lo:103: 00000100:00100000:0.0:1788587023.258933:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309870592:0@lo:103: 00000100:00100000:0.0:1788587023.259136:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.260959:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788587023.260975:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309870336:0@lo:103: 00000100:00100000:2.0:1788587023.261040:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.261054:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309870848:0@lo:103: 00000100:00100000:2.0:1788587023.261076:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587023.261098:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587023.261109:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309870208 00000100:00100000:2.0:1788587023.261117:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309870208 00010000:00010000:2.0:1788587023.261153:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 22 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.261176:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309870464 00000100:00100000:2.0:1788587023.261179:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309870464 00010000:00010000:2.0:1788587023.261222:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 23 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.261236:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309870976 00000100:00100000:2.0:1788587023.261238:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309870976 00010000:00010000:2.0:1788587023.261249:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 24 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.261262:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309870592 00000100:00100000:2.0:1788587023.261265:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309870592 00010000:00010000:2.0:1788587023.261277:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 25 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.261288:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309870336 00000100:00100000:2.0:1788587023.261290:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309870336 00010000:00010000:2.0:1788587023.261299:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634368d expref: 26 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.261308:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309870848 00000100:00100000:2.0:1788587023.261310:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309870848 00010000:00010000:2.0:1788587023.261318:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 27 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.261341:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587023.261349:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+27:3473:x1875469309870208:12345-0@lo:103: 00010000:00010000:2.0:1788587023.261362:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.261380:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 27 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261392:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 27 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261409:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01483200/0x419e1ae1f63436b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63436b0 expref: 27 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261424:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.261456:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+26:3473:x1875469309870208:12345-0@lo:103: Request processed in 108us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.261463:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587023.261481:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587023.261486:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+25:3475:x1875469309870464:12345-0@lo:103: 00010000:00010000:2.0:1788587023.261494:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.261498:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 25 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261507:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 25 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261517:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f6343678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343671 expref: 25 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261537:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.261578:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309870464:12345-0@lo:103: Request processed in 91us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.261584:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587023.261598:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587023.261604:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+23:3475:x1875469309870976:12345-0@lo:103: 00010000:00010000:2.0:1788587023.261611:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.261615:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 23 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261623:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 23 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261631:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63435c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63435c2 expref: 23 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261640:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.261661:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+22:3475:x1875469309870976:12345-0@lo:103: Request processed in 58us (2838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.261667:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587023.261693:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587023.261699:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+21:3472:x1875469309870592:12345-0@lo:103: 00010000:00010000:2.0:1788587023.261707:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.261711:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 21 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261718:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 21 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261734:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634364e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343647 expref: 21 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261743:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.261771:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+20:3472:x1875469309870592:12345-0@lo:103: Request processed in 72us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.261777:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587023.261789:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587023.261814:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+19:3475:x1875469309870336:12345-0@lo:103: 00010000:00010000:2.0:1788587023.261822:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.261827:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634368d expref: 19 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261836:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634368d expref: 19 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261845:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cc800/0x419e1ae1f6343694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634368d expref: 19 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261853:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.261874:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+18:3475:x1875469309870336:12345-0@lo:103: Request processed in 80us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.261879:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587023.261890:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587023.261894:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+17:3475:x1875469309870848:12345-0@lo:103: 00010000:00010000:2.0:1788587023.261902:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.261906:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 17 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261919:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 17 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261928:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f63435f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63435ec expref: 17 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.261937:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.261957:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+16:3475:x1875469309870848:12345-0@lo:103: Request processed in 62us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.261962:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587023.261996:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309870592:0@lo:103: 00000100:00100000:2.0:1788587023.262020:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.262047:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309870208:0@lo:103: 00000100:00100000:2.0:1788587023.262064:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309870720 00000100:00100000:2.0:1788587023.262067:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309870720 00010000:00010000:2.0:1788587023.262083:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634362b expref: 16 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.262096:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587023.262102:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+16:3473:x1875469309870720:12345-0@lo:103: 00010000:00010000:2.0:1788587023.262108:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.262112:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634362b expref: 16 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262121:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634362b expref: 16 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262131:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634362b expref: 16 pid: 6467 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262149:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262157:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262172:0:6457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262180:0:6457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262187:0:6457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262194:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262200:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587023.262204:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262224:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262240:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262251:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.262278:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+15:3473:x1875469309870720:12345-0@lo:103: Request processed in 176us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.262292:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587023.262340:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309870720:0@lo:103: 00010000:00010000:2.0:1788587023.262368:0:6467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262376:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.262382:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01482e00/0x419e1ae1f63436d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587023.262397:0:6467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788587023.262850:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309870336:0@lo:103: 00000100:00100000:0.0:1788587023.262875:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309870848:0@lo:103: 00000100:00100000:0.0:1788587023.262883:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309870464:0@lo:103: 00000100:00100000:0.0:1788587023.262890:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309870976:0@lo:103: 00000100:00100000:2.0:1788587023.334096:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+14:9052:x1875469309869184:12345-0@lo:253: Request processed in 123446us (126081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.334112:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788587023.334205:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309869184:0@lo:253: 10000000:01000000:0.0:1788587023.334229:0:9052:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788587023.334232:0:9052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587023.334234:0:9052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788587023.334235:0:9052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587023.334236:0:9052:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788587023.334238:0:9052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587023.334239:0:9052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587023.334240:0:9052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587023.334242:0:9052:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788587023.334243:0:9052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587023.334245:0:9052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788587023.334269:0:9052:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe040c5800 from lustre-OST0001 10000000:01000000:0.0:1788587023.334294:0:9052:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788587023.334297:0:9052:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788587023.334306:0:9052:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf053a99c0 local copy 10000000:01000000:0.0:1788587023.334310:0:9052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788587023.334648:0:9052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.334660:0:9052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.334791:0:9052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587023.334894:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871104:0@lo:101: 00000100:00100000:0.0:1788587023.334943:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.335024:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587023.335071:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309871104 00000100:00100000:1.0:1788587023.335079:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309871104 00000100:00100000:1.0:1788587023.335161:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788587023.335171:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+14:9052:x1875469309871104:12345-0@lo:101: 00010000:00010000:1.0:1788587023.335184:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587023.335198:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f63436e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63436da expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.335232:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f63436e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63436da expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.335243:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f63436e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63436da expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.335253:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cca00, rc 0) 00000100:00100000:1.0:1788587023.335299:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871104:12345-0@lo:101: Request processed in 129us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587023.335305:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788587023.335373:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871104:0@lo:101: 00010000:00010000:0.0:1788587023.335386:0:9052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.335395:0:9052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587023.335507:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871232:0@lo:501: 00000100:00100000:0.0:1788587023.335533:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.336990:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309871232 00000100:00100000:2.0:1788587023.337003:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309871232 00000100:00100000:0.0:1788587023.337025:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587023.337077:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788587023.337087:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871232:12345-0@lo:501: 00000100:00100000:1.0:1788587023.337377:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871232:12345-0@lo:501: Request processed in 281us (1831us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587023.337384:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788587023.337691:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871232:0@lo:501: 10000000:01000000:0.0:1788587023.337783:0:9052:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788587023.337852:0:9052:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788587023.337860:0:9052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.337871:0:9052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.337886:0:9052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.337905:0:9052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788587023.337931:0:9052:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe040c5800 10000000:01000000:0.0:1788587023.337936:0:9052:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788587023.337942:0:9052:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788587023.337945:0:9052:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587023.337949:0:9052:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788587023.337952:0:9052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788587023.337979:0:9052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.337988:0:9052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.337997:0:9052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.338004:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587023.338009:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587023.338013:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871360:0@lo:101: 00010000:00010000:1.0:1788587023.338017:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587023.338020:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.338028:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587023.338035:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587023.338041:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788587023.338048:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587023.338060:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.338066:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788587023.338081:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587023.338118:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309871360 00000100:00100000:3.0:1788587023.338123:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309871360 00000100:00100000:3.0:1788587023.338163:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788587023.338171:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871360:12345-0@lo:101: 00010000:00010000:3.0:1788587023.338181:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587023.338193:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63436e8 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.338237:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.338247:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.338257:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01483600, rc 0) 00000100:00100000:3.0:1788587023.338292:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309871360:12345-0@lo:101: Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.338298:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788587023.338456:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871360:0@lo:101: 00010000:00010000:0.0:1788587023.338469:0:9052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.338478:0:9052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.338505:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309871488:0@lo:103: 00000100:00100000:2.0:1788587023.338535:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.338572:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871616:0@lo:501: 00010000:00010000:1.0:1788587023.338615:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.338623:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63436da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x419e1ae1f63436e1 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587023.338636:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587023.338638:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587023.338645:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587023.338661:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309871488 00000100:00100000:3.0:1788587023.338666:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309871488 00000100:00100000:3.0:1788587023.338777:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587023.338784:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+16:3472:x1875469309871488:12345-0@lo:103: 00010000:00010000:3.0:1788587023.338817:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587023.338830:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f63436e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63436da expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.338841:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587023.339405:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.339420:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+15:3472:x1875469309871488:12345-0@lo:103: Request processed in 635us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.339423:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587023.339436:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587023.339570:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309871488:0@lo:103: 00000100:00100000:1.0:1788587023.339623:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309871616 00000100:00100000:1.0:1788587023.339628:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309871616 00000100:00100000:1.0:1788587023.339663:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788587023.339783:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871616:12345-0@lo:501: 00000100:00100000:1.0:1788587023.340261:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871616:12345-0@lo:501: Request processed in 590us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587023.340268:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788587023.340320:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871616:0@lo:501: 00000100:00100000:0.0:1788587023.340354:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871744:0@lo:503: 00000100:00100000:0.0:1788587023.340396:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.340527:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587023.340565:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309871744 00000100:00100000:3.0:1788587023.340570:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309871744 00000100:00100000:3.0:1788587023.340636:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788587023.340644:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871744:12345-0@lo:503: 00000100:00100000:3.0:1788587023.340984:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871744:12345-0@lo:503: Request processed in 340us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.340997:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788587023.341052:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871744:0@lo:503: 00000040:00080000:1.0:1788587023.341537:0:9052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587023.341604:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871872:0@lo:502: 00000100:00100000:1.0:1788587023.341650:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587023.341787:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.341855:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309871872 00000100:00100000:0.0:1788587023.341861:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309871872 00000100:00100000:0.0:1788587023.341888:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788587023.341894:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871872:12345-0@lo:502: 00000100:00100000:0.0:1788587023.342165:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309871872:12345-0@lo:502: Request processed in 269us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.342172:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788587023.342242:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309871872:0@lo:502: 00000040:00080000:1.0:1788587023.342580:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788587023.342627:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788587023.342659:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788587023.342819:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788587023.342862:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788587023.342896:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788587023.342927:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872000:0@lo:502: 00000100:00100000:1.0:1788587023.342979:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587023.343016:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587023.343056:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309872000 00000100:00100000:3.0:1788587023.343060:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309872000 00000100:00100000:3.0:1788587023.343190:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788587023.343199:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309872000:12345-0@lo:502: 00000100:00100000:3.0:1788587023.343400:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309872000:12345-0@lo:502: Request processed in 202us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.343408:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788587023.343541:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872000:0@lo:502: 00000040:00080000:1.0:1788587023.343631:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788587023.343641:0:9052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788587023.344397:0:9061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587023.344407:0:9061:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788587023.344413:0:9061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587023.344415:0:9061:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788587023.344421:0:9061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587023.344513:0:9061:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cbe044f4d40) 00000020:00000080:3.0:1788587023.344538:0:9061:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788587023.344545:0:9061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788587023.344600:0:9061:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe040c5800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788587023.344609:0:9061:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788587023.344616:0:9061:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x419e1ae1f63436fd 00010000:00010000:3.0:1788587023.349984:0:9061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788587023.350416:0:9061:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788587023.353835:0:9061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788587023.354165:0:9061:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788587023.360315:0:9061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788587023.361011:0:9061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788587023.363250:0:9061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788587023.363264:0:9061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587023.363271:0:9061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587023.363273:0:9061:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788587023.363277:0:9061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587023.363281:0:9061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587023.363282:0:9061:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788587023.363285:0:9061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788587023.363287:0:9061:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788587023.363337:0:9061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587023.363341:0:9061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587023.363342:0:9061:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788587023.363346:0:9061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788587023.363910:0:9052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788587023.363940:0:9052:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788587023.365179:0:9052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.365195:0:9052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587023.365223:0:9052:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe040c5800 from 1 10000000:01000000:2.0:1788587023.365226:0:9052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587023.365263:0:9052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.365271:0:9052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.365282:0:9052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.365305:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872128:0@lo:101: 00000100:00100000:2.0:1788587023.365384:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.365434:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf271826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.366220:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309872128 00000100:00100000:0.0:1788587023.366230:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309872128 00000100:00100000:0.0:1788587023.366280:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788587023.366289:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309872128:12345-0@lo:101: 00010000:00010000:0.0:1788587023.366303:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587023.366318:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343704 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.366341:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.366353:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.366362:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482000, rc 0) 00000100:00100000:0.0:1788587023.366417:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872128:12345-0@lo:101: Request processed in 129us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.366435:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788587023.366495:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872128:0@lo:101: 00010000:00010000:0.0:1788587023.366511:0:9052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.366521:0:9052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587023.366624:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872256:0@lo:501: 00000100:00100000:0.0:1788587023.366654:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.366843:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.366864:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309872256 00000100:00100000:0.0:1788587023.366878:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309872256 00000100:00100000:0.0:1788587023.366904:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788587023.366910:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872256:12345-0@lo:501: 00000100:00100000:0.0:1788587023.367133:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872256:12345-0@lo:501: Request processed in 222us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.367140:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788587023.367172:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872256:0@lo:501: 00000100:00100000:0.0:1788587023.367200:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872384:0@lo:503: 00000100:00100000:0.0:1788587023.367251:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.367265:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.367279:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309872384 00000100:00100000:0.0:1788587023.367282:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309872384 00000100:00100000:0.0:1788587023.367304:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788587023.367311:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872384:12345-0@lo:503: 00000100:00100000:0.0:1788587023.367609:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872384:12345-0@lo:503: Request processed in 297us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.367616:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788587023.367659:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872384:0@lo:503: 00000040:00080000:0.0:1788587023.369661:0:9052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587023.370263:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872512:0@lo:502: 00000100:00100000:0.0:1788587023.370347:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.370388:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.370417:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309872512 00000100:00100000:0.0:1788587023.370928:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309872512 00000100:00100000:0.0:1788587023.371012:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788587023.371021:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872512:12345-0@lo:502: 00000100:00100000:0.0:1788587023.371301:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872512:12345-0@lo:502: Request processed in 281us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.371309:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788587023.375368:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872512:0@lo:502: 00000040:00080000:2.0:1788587023.376060:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788587023.376264:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788587023.376309:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872640:0@lo:502: 00000100:00100000:2.0:1788587023.376386:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.376535:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27182b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587023.376573:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309872640 00000100:00100000:1.0:1788587023.376588:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309872640 00000100:00100000:1.0:1788587023.376680:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788587023.376690:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872640:12345-0@lo:502: 00000100:00100000:1.0:1788587023.376951:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872640:12345-0@lo:502: Request processed in 261us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587023.376959:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788587023.377055:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872640:0@lo:502: 00000040:00080000:2.0:1788587023.377173:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788587023.377184:0:9052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788587023.377972:0:9065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587023.377984:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587023.377986:0:9065:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788587023.377995:0:9065:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe040c5800 00000020:00000080:2.0:1788587023.378005:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587023.378029:0:9065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587023.378032:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587023.378034:0:9065:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788587023.378037:0:9065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788587023.378260:0:9052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788587023.378283:0:9052:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587023.378305:0:9052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.378326:0:9052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587023.378371:0:9052:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788587023.378374:0:9052:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe040c5800 10000000:01000000:3.0:1788587023.378377:0:9052:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe040c5800 10000000:01000000:3.0:1788587023.378391:0:9052:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587023.378397:0:9052:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe040c5800 from 1 10000000:01000000:3.0:1788587023.378400:0:9052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587023.378442:0:9052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.378450:0:9052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.378459:0:9052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.378478:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872768:0@lo:101: 00000100:00100000:3.0:1788587023.378530:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.378779:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.378948:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309872768 00000100:00100000:0.0:1788587023.378955:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309872768 00000100:00100000:0.0:1788587023.378992:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788587023.379000:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:9052:x1875469309872768:12345-0@lo:101: 00010000:00010000:0.0:1788587023.379012:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587023.379024:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343712 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.379048:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.379058:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587023.379066:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482600, rc 0) 00000100:00100000:0.0:1788587023.379241:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309872768:12345-0@lo:101: Request processed in 241us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.379249:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788587023.379323:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872768:0@lo:101: 00010000:00010000:3.0:1788587023.379337:0:9052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.379346:0:9052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587023.379529:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872896:0@lo:501: 00000100:00100000:3.0:1788587023.379559:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.379589:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.379632:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309872896 00000100:00100000:0.0:1788587023.379636:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309872896 00000100:00100000:0.0:1788587023.379657:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788587023.379662:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309872896:12345-0@lo:501: 00000100:00100000:0.0:1788587023.379970:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309872896:12345-0@lo:501: Request processed in 306us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.379977:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788587023.380084:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309872896:0@lo:501: 00000100:00100000:3.0:1788587023.380246:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309873024:0@lo:503: 00000100:00100000:3.0:1788587023.380286:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.380306:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587023.380365:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309873024 00000100:00100000:1.0:1788587023.380370:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309873024 00000100:00100000:1.0:1788587023.380397:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788587023.380402:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309873024:12345-0@lo:503: 00000100:00100000:1.0:1788587023.380635:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309873024:12345-0@lo:503: Request processed in 231us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587023.380642:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788587023.380834:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309873024:0@lo:503: 00000040:00080000:3.0:1788587023.381520:0:9052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587023.381583:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309873152:0@lo:502: 00000100:00100000:3.0:1788587023.381631:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.381667:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062df480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587023.381764:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309873152 00000100:00100000:2.0:1788587023.381770:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309873152 00000100:00100000:2.0:1788587023.381956:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788587023.381966:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309873152:12345-0@lo:502: 00000100:00100000:2.0:1788587023.382194:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309873152:12345-0@lo:502: Request processed in 229us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.382201:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788587023.382321:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309873152:0@lo:502: 00000040:00080000:3.0:1788587023.382604:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788587023.382655:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788587023.382718:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788587023.382766:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788587023.382831:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788587023.382882:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788587023.382921:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788587023.382954:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788587023.383001:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788587023.383037:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788587023.383070:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788587023.383117:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788587023.383152:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788587023.383198:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788587023.383260:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788587023.383297:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788587023.383330:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788587023.383376:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788587023.383427:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788587023.383464:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788587023.383514:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788587023.383552:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788587023.383582:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788587023.383641:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788587023.383681:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788587023.383715:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788587023.383779:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788587023.383848:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788587023.383880:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788587023.383921:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788587023.383952:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788587023.383982:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788587023.384014:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788587023.384061:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788587023.384109:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788587023.384158:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788587023.384194:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788587023.384243:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788587023.384293:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788587023.384329:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788587023.384364:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788587023.384397:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788587023.384445:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788587023.384482:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788587023.384518:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788587023.384581:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788587023.384628:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309873280:0@lo:502: 00000100:00100000:3.0:1788587023.384694:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.385664:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.385828:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309873280 00000100:00100000:0.0:1788587023.385837:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309873280 00000100:00100000:0.0:1788587023.385896:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788587023.385905:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309873280:12345-0@lo:502: 00000100:00100000:0.0:1788587023.386367:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309873280:12345-0@lo:502: Request processed in 462us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.386376:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788587023.386847:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309873280:0@lo:502: 00000040:00080000:3.0:1788587023.386958:0:9052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788587023.386973:0:9052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788587023.392047:0:9066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788587023.392066:0:9066:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cbf3b88cd40) 00000020:00000080:1.0:1788587023.392103:0:9066:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788587023.392284:0:9066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe040c5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587023.392289:0:9066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe040c5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587023.392291:0:9066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe040c5800 3 00010000:00080000:1.0:1788587023.392322:0:9066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf04939800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587023.397928:0:9066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788587023.398331:0:9066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788587023.398374:0:9066:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587023.398388:0:9066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x419e1ae1f6343727 00000100:00080000:1.0:1788587023.398399:0:9066:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587023.398405:0:9066:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbf04939800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587023.398575:0:9066:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d55180 x1875469309873408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587023.398622:0:9066:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788587023.398945:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469309873408:0@lo:38: 00000100:00100000:0.0:1788587023.399022:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.399359:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309873408 00000100:00100000:3.0:1788587023.399368:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309873408 00000100:00100000:3.0:1788587023.399410:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587023.399418:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469309873408:12345-0@lo:38: 00010000:00080000:3.0:1788587023.399520:0:6472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:3.0:1788587023.399571:0:6472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x419e1ae1f634372e 00000004:00100000:3.0:1788587023.399587:0:6472:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788587023.399617:0:6472:0:(import.c:65:import_set_state_nolock()) ffff8cbe03db3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587023.399745:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1875469309873408:12345-0@lo:38: Request processed in 252us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.399753:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788587023.399872:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf35d55180 x1875469309873408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.399883:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788587023.399891:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788587023.399897:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788587023.399901:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788587023.399903:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf04939800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788587023.399909:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469309873408:0@lo:38: 00000100:00100000:0.0:1788587023.400245:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309873536:0@lo:400: 00000100:00100000:0.0:1788587023.400282:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.400315:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309874048:0@lo:400: 00000100:00100000:0.0:1788587023.400340:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.400361:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788587023.400367:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309873920:0@lo:400: 00000100:00100000:0.0:1788587023.400391:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.400409:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309874432:0@lo:400: 00000100:00100000:0.0:1788587023.400530:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.400563:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309873664:0@lo:400: 00000100:00100000:0.0:1788587023.400585:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.400602:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309874176:0@lo:400: 00000100:00100000:0.0:1788587023.400624:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.400644:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788587023.400649:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309873792:0@lo:400: 00000100:00100000:0.0:1788587023.400742:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.400762:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309874304:0@lo:400: 00000100:00100000:0.0:1788587023.400783:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.400838:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309873536 00000100:00100000:0.0:1788587023.400844:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309873536 00000100:00100000:0.0:1788587023.400887:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309874048 00000100:00100000:0.0:1788587023.400891:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309874048 00000100:00100000:0.0:1788587023.400903:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309874176 00000100:00100000:0.0:1788587023.400906:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309874176 00000100:00100000:0.0:1788587023.400915:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309873792 00000100:00100000:0.0:1788587023.400917:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309873792 00000100:00100000:0.0:1788587023.400929:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587023.400936:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309873536:12345-0@lo:400: 00000100:00100000:0.0:1788587023.400980:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309873536:12345-0@lo:400: Request processed in 45us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.400987:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587023.401000:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587023.401006:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309874048:12345-0@lo:400: 00000100:00100000:0.0:1788587023.401029:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309874048:12345-0@lo:400: Request processed in 24us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.401044:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587023.401056:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587023.401061:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309874176:12345-0@lo:400: 00000020:01000004:1.0:1788587023.401305:0:9066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788587023.401320:0:9066:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8cbf3b888000) 00000020:00000080:1.0:1788587023.401341:0:9066:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788587023.401501:0:9066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe040c5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587023.401507:0:9066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe040c5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587023.401510:0:9066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe040c5800 3 00010000:00080000:1.0:1788587023.401537:0:9066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe040c0800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.114@tcp at head 00000100:00100000:0.0:1788587023.402220:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309874176:12345-0@lo:400: Request processed in 44us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.402231:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587023.402254:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587023.402263:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309873792:12345-0@lo:400: 00000100:00100000:0.0:1788587023.402319:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309873792:12345-0@lo:400: Request processed in 58us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.402325:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587023.402348:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309873920 00000100:00100000:0.0:1788587023.402354:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309873920 00000100:00100000:0.0:1788587023.402375:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309873664 00000100:00100000:0.0:1788587023.402378:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309873664 00000100:00100000:0.0:1788587023.402388:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587023.402394:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309873920:12345-0@lo:400: 00000100:00100000:3.0:1788587023.402951:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309874432 00000100:00100000:3.0:1788587023.402958:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309874432 00000100:00100000:3.0:1788587023.402994:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309874304 00000100:00100000:3.0:1788587023.402998:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309874304 00000100:00100000:3.0:1788587023.403017:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587023.403025:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309874432:12345-0@lo:400: 00010000:00010000:1.0:1788587023.407827:0:9066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788587023.408028:0:9066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788587023.408071:0:9066:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587023.408084:0:9066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x419e1ae1f634373c 00000100:00080000:1.0:1788587023.408095:0:9066:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587023.408113:0:9066:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cbe040c0800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587023.408153:0:9066:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d56300 x1875469309874560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587023.408180:0:9066:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788587023.408290:0:9067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9067:1875469309874688:0@lo:901: 00000100:00100000:3.0:1788587023.409237:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587023.409254:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309874304:12345-0@lo:400: 00000100:00100000:3.0:1788587023.409328:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309874304:12345-0@lo:400: Request processed in 80us (8542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.409346:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587023.409648:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309874432:12345-0@lo:400: Request processed in 6623us (9116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.409656:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587023.412279:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309873920:12345-0@lo:400: Request processed in 9875us (11877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.412293:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587023.412332:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469309874560:0@lo:38: 00000100:00100000:0.0:1788587023.412396:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788587023.412599:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05736a00 x1875469309873792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.412614:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309873792:0@lo:400: 00010000:00080000:0.0:1788587023.412641:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05737800 x1875469309874304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.412649:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309874304:0@lo:400: 00010000:00080000:0.0:1788587023.412662:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05736680 x1875469309874176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.413526:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309874176:0@lo:400: 00000100:00100000:0.0:1788587023.413577:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309873920:0@lo:400: 00010000:00080000:0.0:1788587023.413592:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05735500 x1875469309874432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.413601:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309874432:0@lo:400: 00010000:00080000:0.0:1788587023.413613:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05734e00 x1875469309873536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.413620:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309873536:0@lo:400: 00010000:00080000:0.0:1788587023.413629:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05734700 x1875469309874048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.413636:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309874048:0@lo:400: 00000100:00100000:0.0:1788587023.414299:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309874816:0@lo:41: 00000100:00100000:0.0:1788587023.414365:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587023.414414:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309874816 00000100:00100000:0.0:1788587023.414497:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309874816 00000100:00100000:0.0:1788587023.414537:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587023.414546:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309873664:12345-0@lo:400: 00000100:00100000:0.0:1788587023.414601:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309873664:12345-0@lo:400: Request processed in 55us (14014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.414614:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587023.414631:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587023.414637:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309874816:12345-0@lo:41: 00000004:00000024:0.0:1788587023.414667:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587023.414973:0:9067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587023.414998:0:9067:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.415824:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309874816:12345-0@lo:41: Request processed in 1184us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.415832:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587023.415875:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309873664:0@lo:400: 00000100:00100000:1.0:1788587023.416545:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309874816:0@lo:41: 00000100:00100000:0.0:1788587023.417567:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309874688 00000100:00100000:0.0:1788587023.417578:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309874688 00000100:00100000:0.0:1788587023.418553:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587023.418566:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9067:x1875469309874688:12345-0@lo:901: 00000100:00100000:0.0:1788587023.419070:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9067:x1875469309874688:12345-0@lo:901: Request processed in 506us (4095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.419079:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788587023.419220:0:9067:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf35d55c00 x1875469309874688/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788587039 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.419234:0:9067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9067:1875469309874688:0@lo:901: 00000100:00100000:3.0:1788587023.419551:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309874560 00000100:00100000:3.0:1788587023.419558:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309874560 00000100:00100000:3.0:1788587023.419594:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587023.419600:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469309874560:12345-0@lo:38: 00010000:00080000:3.0:1788587023.419624:0:6474:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:3.0:1788587023.419659:0:6474:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x419e1ae1f6343743 00000004:00100000:3.0:1788587023.420202:0:6474:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788587023.420245:0:6474:0:(import.c:65:import_set_state_nolock()) ffff8cbe058ae000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788587023.420810:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587023.423456:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1875469309874560:12345-0@lo:38: Request processed in 3845us (11051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.423472:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788587023.423745:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf35d56300 x1875469309874560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587023.423758:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788587023.423769:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788587023.423779:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788587023.423784:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788587023.423787:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788587023.423828:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469309874560:0@lo:38: 00000040:00080000:3.0:1788587023.424053:0:9066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788587023.424284:0:9052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788587023.424308:0:9052:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587023.424321:0:9052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587023.424331:0:9052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788587023.424383:0:9052:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587023.424385:0:9052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587023.424387:0:9052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587023.424388:0:9052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587023.424392:0:9052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587023.424393:0:9052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587023.424395:0:9052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587023.424396:0:9052:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587023.424397:0:9052:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587023.424398:0:9052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587023.424399:0:9052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587023.424403:0:9052:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788587023.424405:0:9052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587023.424406:0:9052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587023.424407:0:9052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587023.424407:0:9052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587023.424408:0:9052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587023.424409:0:9052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587023.424410:0:9052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587023.424411:0:9052:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587023.424412:0:9052:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587023.424413:0:9052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587023.424414:0:9052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587023.424449:0:9052:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788587023.424466:0:9052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309874944:0@lo:253: 00000100:00100000:3.0:1788587023.424526:0:9052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.424557:0:9052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587023.424829:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309874944 00000100:00100000:0.0:1788587023.424836:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309874944 00000100:00100000:0.0:1788587023.424881:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788587023.424891:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9052:x1875469309874944:12345-0@lo:253: 20000000:01000000:0.0:1788587023.424916:0:6465:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788587023.424930:0:6465:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788587023.463392:0:6465:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788587023.463411:0:6465:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788587023.463507:0:6488:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587023.463512:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587023.463534:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.463555:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.463563:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634367f expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.463570:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.463611:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634367f expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.463627:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634367f expref: 17 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.463658:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309875072:0@lo:104: 00000100:00100000:2.0:1788587023.463734:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587023.463817:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.463827:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 17 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.463835:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309875200:0@lo:104: 00000100:00100000:2.0:1788587023.463858:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.463880:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587023.463900:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309875072 00000100:00100000:2.0:1788587023.463906:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309875072 00000100:00100000:2.0:1788587023.463948:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309875200 00000100:00100000:2.0:1788587023.463952:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309875200 00000100:00100000:2.0:1788587023.463967:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587023.463975:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:6488:x1875469309875072:12345-0@lo:104: 00010000:00010000:2.0:1788587023.463988:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464036:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587023.464042:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:6488:x1875469309875072:12345-0@lo:104: Request processed in 69us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.464049:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587023.464066:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587023.464072:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6488:x1875469309875200:12345-0@lo:104: 00010000:00010000:2.0:1788587023.464080:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464466:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587023.464473:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:6488:x1875469309875200:12345-0@lo:104: Request processed in 402us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.464480:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788587023.464503:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587023.464511:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464518:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587023.464522:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464531:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587023.464538:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587023.464545:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587023.464574:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464580:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587023.464596:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464603:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc200/0x419e1ae1f634367f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343686 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464631:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587023.464635:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464640:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587023.464643:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464650:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587023.464656:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587023.464661:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587023.464755:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587023.464880:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464888:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587023.464894:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464901:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f6343639 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343640 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.464914:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587023.464916:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587023.464918:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587023.464939:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309875328:0@lo:103: 00000100:00100000:2.0:1788587023.464980:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.465013:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587023.465019:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309875456:0@lo:103: 00000100:00100000:2.0:1788587023.465040:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.465069:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309875328 00000100:00100000:2.0:1788587023.465075:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309875328 00010000:00010000:2.0:1788587023.465235:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634367f expref: 18 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.465260:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309875456 00000100:00100000:2.0:1788587023.465263:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309875456 00010000:00010000:2.0:1788587023.465276:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 19 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.465289:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587023.465296:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+19:3474:x1875469309875328:12345-0@lo:103: 00010000:00010000:2.0:1788587023.465307:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.465312:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634367f expref: 19 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465324:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634367f expref: 19 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465339:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.465368:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+19:3474:x1875469309875328:12345-0@lo:103: Request processed in 73us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.465375:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587023.465387:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587023.465393:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+18:3474:x1875469309875456:12345-0@lo:103: 00010000:00010000:2.0:1788587023.465409:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587023.465414:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 18 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465559:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 18 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465573:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465580:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587023.465595:0:6458:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011161888s 00010000:00010000:2.0:1788587023.465600:0:6458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465607:0:6458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465614:0:6458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465620:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465624:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587023.465629:0:6458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465636:0:6458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465652:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465663:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587023.465770:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+18:3474:x1875469309875456:12345-0@lo:103: Request processed in 376us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.465776:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587023.465900:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309875456:0@lo:103: 00000100:00100000:2.0:1788587023.465908:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309875328:0@lo:103: 00010000:00010000:2.0:1788587023.465936:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634367f expref: 17 pid: 6465 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.465947:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309875072:0@lo:104: 00010000:00010000:2.0:1788587023.465957:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f6343640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343639 expref: 16 pid: 6464 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587023.465964:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6488:1875469309875200:0@lo:104: 00010000:00010000:2.0:1788587023.465978:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465986:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465993:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587023.465999:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044000/0x419e1ae1f634374a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587023.481455:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:9052:x1875469309874944:12345-0@lo:253: Request processed in 56557us (56919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.481471:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788587023.481612:0:9052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5a87955-d364-4ecd-b672-456c35aa135f:9052:1875469309874944:0@lo:253: 10000000:01000000:2.0:1788587023.481628:0:9052:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788587023.481632:0:9052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587023.481633:0:9052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587023.481635:0:9052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587023.481636:0:9052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587023.481637:0:9052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587023.481638:0:9052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587023.481639:0:9052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587023.481641:0:9052:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788587023.481642:0:9052:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788587023.481644:0:9052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587023.481645:0:9052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788587023.481659:0:9052:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788587023.488164:0:9052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587023.488523:0:9052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587023.488843:0:9052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587023.489015:0:9052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587023.489391:0:9052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587023.489781:0:9052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788587023.492539:0:9052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788587023.774157:0:9052:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788587023.774165:0:9052:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788587023.774225:0:9052:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788587023.774306:0:9052:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788587023.774319:0:9052:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788587023.774346:0:9052:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788587023.792955:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587024.818599:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587025.845647:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587026.858910:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587027.883333:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587028.011941:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587028.011966:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309875584:0@lo:41: 00000100:00100000:3.0:1788587028.012053:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.012920:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587028.012933:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309875712:0@lo:13: 00000100:00100000:3.0:1788587028.012969:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587028.014550:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309875584 00000100:00100000:0.0:1788587028.014563:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309875584 00000100:00100000:0.0:1788587028.014617:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587028.014627:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309875584:12345-0@lo:41: 00000004:00000024:0.0:1788587028.014668:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587028.014731:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309875584:12345-0@lo:41: Request processed in 107us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587028.014738:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587028.014760:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309875712 00000100:00100000:0.0:1788587028.014763:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309875712 00000100:00100000:0.0:1788587028.014812:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587028.014883:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309875712:12345-0@lo:13: 00002000:00000024:0.0:1788587028.014904:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587028.014939:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309875712:12345-0@lo:13: Request processed in 59us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587028.014945:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587028.014984:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587028.015008:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309875840:0@lo:13: 00000100:00100000:0.0:1788587028.015040:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788587028.016672:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587028.016691:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309875840 00000100:00100000:0.0:1788587028.016700:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309875840 00000100:00100000:0.0:1788587028.016958:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587028.016968:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309875840:12345-0@lo:13: 00002000:00000024:0.0:1788587028.016990:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587028.020382:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309875840:12345-0@lo:13: Request processed in 80us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587028.020396:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788587028.020789:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05734380 x1875469309875712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587028.020838:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309875712:0@lo:13: 00000100:00100000:0.0:1788587028.020886:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309875584:0@lo:41: 00010000:00080000:0.0:1788587028.021235:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdf800 x1875469309875840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587028.021256:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309875840:0@lo:13: 00000100:00080000:3.0:1788587028.024077:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587028.524071:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309875968:0@lo:41: 00000100:00100000:3.0:1788587028.524258:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.524382:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309875968 00000100:00100000:3.0:1788587028.524500:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309875968 00000100:00100000:3.0:1788587028.524551:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587028.524561:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309875968:12345-0@lo:41: 00000004:00000024:3.0:1788587028.524596:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587028.524638:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309875968:12345-0@lo:41: Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.524644:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587028.524694:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309875968:0@lo:41: 00000100:00100000:1.0:1788587028.525140:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309876224:0@lo:400: 00000100:00100000:1.0:1788587028.525172:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.525201:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309876736:0@lo:400: 00000100:00100000:1.0:1788587028.525220:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.525234:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309877248:0@lo:400: 00000100:00100000:1.0:1788587028.525258:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.525281:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788587028.525286:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309876096:0@lo:400: 00000100:00100000:1.0:1788587028.525313:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.525334:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309876608:0@lo:400: 00000100:00100000:1.0:1788587028.525353:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.525377:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309877120:0@lo:400: 00000100:00100000:1.0:1788587028.525544:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.525567:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309876096 00000100:00100000:1.0:1788587028.525573:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309876096 00000100:00100000:1.0:1788587028.525610:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788587028.525617:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:3473:x1875469309876096:12345-0@lo:400: 00000100:00100000:1.0:1788587028.525652:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+15:3473:x1875469309876096:12345-0@lo:400: Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587028.525659:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788587028.525690:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309876096:0@lo:400: 00000100:00100000:3.0:1788587028.531812:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309876224 00000100:00100000:3.0:1788587028.531828:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309876224 00000100:00100000:3.0:1788587028.531884:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309876736 00000100:00100000:3.0:1788587028.531887:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309876736 00000100:00100000:3.0:1788587028.531930:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309877248 00000100:00100000:3.0:1788587028.531933:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309877248 00000100:00100000:3.0:1788587028.531946:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309876608 00000100:00100000:3.0:1788587028.531948:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309876608 00000100:00100000:3.0:1788587028.531960:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309877120 00000100:00100000:3.0:1788587028.531963:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309877120 00000100:00100000:3.0:1788587028.531980:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587028.531988:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309876224:12345-0@lo:400: 00000100:00080000:1.0:1788587028.532047:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587028.532052:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587028.532077:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309876224:12345-0@lo:400: Request processed in 90us (6904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.532084:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587028.532101:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587028.533216:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309876736:12345-0@lo:400: 00000100:00100000:3.0:1788587028.533278:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309876736:12345-0@lo:400: Request processed in 1171us (8056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.533286:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587028.533320:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788587028.533328:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309877248:12345-0@lo:400: 00010000:00080000:0.0:1788587028.533348:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d55880 x1875469309876224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587028.533358:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309877248:12345-0@lo:400: Request processed in 32us (8100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.533363:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587028.533363:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309876224:0@lo:400: 00000100:00100000:3.0:1788587028.533373:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788587028.533379:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d56300 x1875469309876736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587028.533380:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309876608:12345-0@lo:400: 00000100:00100000:0.0:1788587028.533399:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309876736:0@lo:400: 00000100:00100000:3.0:1788587028.533404:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309876608:12345-0@lo:400: Request processed in 26us (8051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.533410:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788587028.533411:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d54380 x1875469309877248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587028.533420:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587028.533426:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309877120:12345-0@lo:400: 00000100:00100000:3.0:1788587028.533451:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309877120:12345-0@lo:400: Request processed in 25us (7908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.533456:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587028.533624:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309877248:0@lo:400: 00010000:00080000:0.0:1788587028.533657:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d57b80 x1875469309876608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587028.533667:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309876608:0@lo:400: 00010000:00080000:0.0:1788587028.533678:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d56d80 x1875469309877120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587028.533684:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309877120:0@lo:400: 00000100:00100000:3.0:1788587028.536371:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309876352:0@lo:400: 00000100:00100000:3.0:1788587028.536613:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.536699:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309876864:0@lo:400: 00000100:00100000:3.0:1788587028.536725:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.536760:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788587028.536767:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309876480:0@lo:400: 00000100:00100000:3.0:1788587028.536811:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.536840:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309876992:0@lo:400: 00000100:00100000:3.0:1788587028.536861:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.536894:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309876864 00000100:00100000:3.0:1788587028.536902:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309876864 00000100:00100000:3.0:1788587028.536956:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309876992 00000100:00100000:3.0:1788587028.536960:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309876992 00000100:00100000:3.0:1788587028.536983:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587028.536992:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309876864:12345-0@lo:400: 00000100:00100000:3.0:1788587028.537060:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309876864:12345-0@lo:400: Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.537067:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587028.537085:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587028.537091:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309876992:12345-0@lo:400: 00000100:00100000:3.0:1788587028.537115:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309876992:12345-0@lo:400: Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.537120:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788587028.537153:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d55180 x1875469309876992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587028.537166:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309876992:0@lo:400: 00010000:00080000:3.0:1788587028.537186:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d55c00 x1875469309876864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587028.537195:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309876864:0@lo:400: 00000100:00100000:3.0:1788587028.537330:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309876480 00000100:00100000:3.0:1788587028.537334:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309876480 00000100:00100000:3.0:1788587028.537360:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587028.537367:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309876480:12345-0@lo:400: 00000100:00100000:3.0:1788587028.537413:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309876480:12345-0@lo:400: Request processed in 46us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.537419:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587028.537469:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309876352 00000100:00100000:0.0:1788587028.537475:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309876352 00000100:00100000:0.0:1788587028.537507:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788587028.537588:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309876352:12345-0@lo:400: 00000100:00100000:0.0:1788587028.537627:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309876352:12345-0@lo:400: Request processed in 113us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587028.537634:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788587028.540011:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d56a00 x1875469309876480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587028.540036:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309876480:0@lo:400: 00000100:00100000:3.0:1788587028.540051:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309876352:0@lo:400: 00010000:00010000:0.0:1788587028.908212:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587029.934574:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587030.131321:0:9412:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788587030.955911:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587031.596278:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788587031.596286:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf3d10b000 from 39 10000000:01000000:2.0:1788587031.596291:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788587031.596334:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587031.596347:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587031.596370:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587031.596392:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309877376:0@lo:101: 00000100:00100000:2.0:1788587031.596456:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.596509:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf133b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.596734:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309877376 00000100:00100000:0.0:1788587031.596742:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309877376 00000100:00100000:0.0:1788587031.596824:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788587031.596833:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309877376:12345-0@lo:101: 00010000:00010000:0.0:1788587031.596845:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587031.596858:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343751 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.596893:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 16 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.596903:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 16 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.597264:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482800, rc 0) 00000100:00100000:0.0:1788587031.597320:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309877376:12345-0@lo:101: Request processed in 487us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.597326:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788587031.597483:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309877376:0@lo:101: 00010000:00010000:1.0:1788587031.597498:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.597508:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587031.597574:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309877504:0@lo:501: 00000100:00100000:1.0:1788587031.597604:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.597644:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.597671:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309877504 00000100:00100000:2.0:1788587031.597676:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309877504 00000100:00100000:2.0:1788587031.597861:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788587031.597870:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309877504:12345-0@lo:501: 00000100:00100000:2.0:1788587031.598289:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309877504:12345-0@lo:501: Request processed in 419us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.598297:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788587031.598363:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309877504:0@lo:501: 00000100:00100000:3.0:1788587031.598396:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309877632:0@lo:503: 00000100:00100000:3.0:1788587031.598437:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.598501:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.598536:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309877632 00000100:00100000:2.0:1788587031.598541:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309877632 00000100:00100000:2.0:1788587031.598569:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788587031.598576:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309877632:12345-0@lo:503: 00000100:00100000:2.0:1788587031.598911:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309877632:12345-0@lo:503: Request processed in 336us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.598919:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788587031.598983:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309877632:0@lo:503: 00000100:00100000:1.0:1788587031.599662:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9516:1875469309877760:0@lo:502: 00000100:00100000:1.0:1788587031.599713:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.599788:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.600286:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309877760 00000100:00100000:0.0:1788587031.600295:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309877760 00000100:00100000:0.0:1788587031.600365:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788587031.600373:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:9516:x1875469309877760:12345-0@lo:502: 00000100:00100000:0.0:1788587031.600604:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:9516:x1875469309877760:12345-0@lo:502: Request processed in 231us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.600612:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788587031.600694:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9516:1875469309877760:0@lo:502: 00000100:00100000:2.0:1788587031.600737:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9516:1875469309877888:0@lo:502: 00000100:00100000:2.0:1788587031.600764:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.600857:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309877888 00000100:00100000:1.0:1788587031.600861:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309877888 00000100:00100000:2.0:1788587031.600874:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf133b7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587031.600887:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788587031.600894:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9516:x1875469309877888:12345-0@lo:502: 00000100:00100000:1.0:1788587031.601536:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9516:x1875469309877888:12345-0@lo:502: Request processed in 641us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587031.601544:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788587031.601756:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9516:1875469309877888:0@lo:502: 00000040:00080000:2.0:1788587031.602405:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788587031.602586:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788587031.602600:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587031.602609:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.602617:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587031.602625:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788587031.602626:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788587031.602628:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788587031.602652:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.602658:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.602664:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.602683:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878016:0@lo:101: 00000100:00100000:3.0:1788587031.602717:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.602779:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.603006:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309878016 00000100:00100000:0.0:1788587031.603022:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309878016 00000100:00100000:0.0:1788587031.603063:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788587031.603072:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309878016:12345-0@lo:101: 00010000:00010000:0.0:1788587031.603083:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587031.603229:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634375f expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.603252:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634375f expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.603274:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634375f expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.603281:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483a00, rc 0) 00000100:00100000:0.0:1788587031.603317:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309878016:12345-0@lo:101: Request processed in 247us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.603323:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587031.603351:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878016:0@lo:101: 00010000:00010000:3.0:1788587031.603364:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.603373:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.603419:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878144:0@lo:501: 00000100:00100000:3.0:1788587031.603445:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.603519:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587031.603560:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309878144 00000100:00100000:1.0:1788587031.603564:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309878144 00000100:00100000:1.0:1788587031.603595:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788587031.603601:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309878144:12345-0@lo:501: 00000100:00100000:1.0:1788587031.604194:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309878144:12345-0@lo:501: Request processed in 591us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587031.604202:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587031.604251:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878144:0@lo:501: 00000100:00100000:3.0:1788587031.604276:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878272:0@lo:503: 00000100:00100000:3.0:1788587031.604304:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.604334:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.604417:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309878272 00000100:00100000:0.0:1788587031.604421:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309878272 00000100:00100000:0.0:1788587031.604454:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788587031.604461:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309878272:12345-0@lo:503: 00000100:00100000:0.0:1788587031.604729:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309878272:12345-0@lo:503: Request processed in 267us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.604736:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788587031.605139:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878272:0@lo:503: 00000100:00100000:1.0:1788587031.605514:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9517:1875469309878400:0@lo:502: 00000100:00100000:1.0:1788587031.605557:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.605618:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.605655:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309878400 00000100:00100000:2.0:1788587031.605660:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309878400 00000100:00100000:2.0:1788587031.605730:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788587031.605738:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:9517:x1875469309878400:12345-0@lo:502: 00000100:00100000:2.0:1788587031.606268:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:9517:x1875469309878400:12345-0@lo:502: Request processed in 529us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.606279:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788587031.606303:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9517:1875469309878400:0@lo:502: 00000020:01000000:1.0:1788587031.606329:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587031.606337:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587031.606340:0:9517:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587031.606345:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587031.606347:0:9517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788587031.606365:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9517:1875469309878528:0@lo:502: 00000100:00100000:1.0:1788587031.606400:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.606433:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343906c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.606491:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309878528 00000100:00100000:0.0:1788587031.606497:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309878528 00000100:00100000:0.0:1788587031.606561:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788587031.606569:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9517:x1875469309878528:12345-0@lo:502: 00000100:00100000:0.0:1788587031.606711:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9517:x1875469309878528:12345-0@lo:502: Request processed in 141us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.606718:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788587031.607252:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9517:1875469309878528:0@lo:502: 00000020:01000000:2.0:1788587031.607275:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587031.607280:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587031.607282:0:9517:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788587031.607285:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788587031.607478:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788587031.607497:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788587031.607506:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.607517:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587031.607540:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788587031.607543:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf04818800 from 39 10000000:01000000:3.0:1788587031.607546:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587031.607575:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.607582:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.607590:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.607753:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878656:0@lo:101: 00000100:00100000:3.0:1788587031.608266:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.608340:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.608387:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309878656 00000100:00100000:2.0:1788587031.608393:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309878656 00000100:00100000:2.0:1788587031.608434:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788587031.608442:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309878656:12345-0@lo:101: 00010000:00010000:2.0:1788587031.608453:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587031.608468:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634376d expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587031.608490:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634376d expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587031.608502:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634376d expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587031.608510:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044400, rc 0) 00000100:00100000:2.0:1788587031.608650:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309878656:12345-0@lo:101: Request processed in 207us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.608656:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788587031.608717:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878656:0@lo:101: 00010000:00010000:3.0:1788587031.608730:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.608739:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.608907:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878784:0@lo:501: 00000100:00100000:3.0:1788587031.608933:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.609062:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.609218:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309878784 00000100:00100000:0.0:1788587031.609223:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309878784 00000100:00100000:0.0:1788587031.609287:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788587031.609295:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309878784:12345-0@lo:501: 00000100:00100000:0.0:1788587031.609543:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309878784:12345-0@lo:501: Request processed in 248us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.609556:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788587031.609619:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878784:0@lo:501: 00000100:00100000:3.0:1788587031.609647:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878912:0@lo:503: 00000100:00100000:3.0:1788587031.609692:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.610061:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587031.610280:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309878912 00000100:00100000:1.0:1788587031.610286:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309878912 00000100:00100000:2.0:1788587031.610339:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788587031.610349:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309878912:12345-0@lo:503: 00000100:00100000:2.0:1788587031.610518:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309878912:12345-0@lo:503: Request processed in 171us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.610525:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788587031.610602:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309878912:0@lo:503: 00000100:00100000:3.0:1788587031.611081:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9518:1875469309879040:0@lo:502: 00000100:00100000:3.0:1788587031.611123:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.611227:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.611427:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309879040 00000100:00100000:0.0:1788587031.611433:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309879040 00000100:00100000:0.0:1788587031.611460:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788587031.611467:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:9518:x1875469309879040:12345-0@lo:502: 00000100:00100000:0.0:1788587031.611674:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:9518:x1875469309879040:12345-0@lo:502: Request processed in 206us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.611681:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788587031.611826:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9518:1875469309879040:0@lo:502: 00000100:00100000:3.0:1788587031.611872:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9518:1875469309879168:0@lo:502: 00000100:00100000:3.0:1788587031.611907:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.611930:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.612040:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309879168 00000100:00100000:0.0:1788587031.612045:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309879168 00000100:00100000:0.0:1788587031.612065:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587031.612142:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:9518:x1875469309879168:12345-0@lo:502: 00000100:00100000:0.0:1788587031.612308:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:9518:x1875469309879168:12345-0@lo:502: Request processed in 236us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.612314:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788587031.612446:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9518:1875469309879168:0@lo:502: 00000040:00080000:3.0:1788587031.612468:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788587031.612626:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788587031.612645:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788587031.612654:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.612664:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587031.612674:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587031.612676:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf04818800 from 6 10000000:01000000:0.0:1788587031.612679:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587031.612705:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.612724:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.612733:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587031.612745:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879296:0@lo:101: 00000100:00100000:0.0:1788587031.612942:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.613068:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309879296 00000100:00100000:3.0:1788587031.613142:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309879296 00000100:00100000:3.0:1788587031.613237:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788587031.613245:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309879296:12345-0@lo:101: 00010000:00010000:3.0:1788587031.613255:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587031.613268:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634377b expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.613290:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634377b expref: 19 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.613300:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634377b expref: 19 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.613308:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01483800, rc 0) 00000100:00100000:3.0:1788587031.613344:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309879296:12345-0@lo:101: Request processed in 100us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.613350:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788587031.613384:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf348373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.613397:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879296:0@lo:101: 00010000:00010000:3.0:1788587031.613410:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.613418:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.613463:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879424:0@lo:256: 00000100:00100000:3.0:1788587031.613494:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.613516:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.613567:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309879424 00000100:00100000:0.0:1788587031.613571:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309879424 00000100:00100000:0.0:1788587031.613589:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788587031.613595:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309879424:12345-0@lo:256: 20000000:01000000:0.0:1788587031.613608:0:6465:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587031.613624:0:6465:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587031.613627:0:6465:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788587031.613707:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309879424:12345-0@lo:256: Request processed in 112us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.613714:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788587031.613791:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879424:0@lo:256: 10000000:01000000:3.0:1788587031.613848:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587031.613853:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.613861:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587031.613867:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788587031.613869:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788587031.613872:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788587031.613888:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.613895:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.613908:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.613921:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879552:0@lo:101: 00000100:00100000:3.0:1788587031.613946:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.613968:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.614082:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309879552 00000100:00100000:0.0:1788587031.614086:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309879552 00000100:00100000:0.0:1788587031.614104:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788587031.614109:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309879552:12345-0@lo:101: 00010000:00010000:0.0:1788587031.614116:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587031.614124:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343789 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.614139:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 20 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.614271:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 20 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.614281:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483200, rc 0) 00000100:00100000:0.0:1788587031.614319:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309879552:12345-0@lo:101: Request processed in 208us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.614324:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587031.614393:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879552:0@lo:101: 00010000:00010000:3.0:1788587031.614404:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.614412:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.614478:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879680:0@lo:501: 00000100:00100000:3.0:1788587031.614505:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.614527:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.614538:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309879680 00000100:00100000:3.0:1788587031.614542:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309879680 00000100:00100000:3.0:1788587031.614562:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788587031.614567:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309879680:12345-0@lo:501: 00000100:00100000:3.0:1788587031.614761:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309879680:12345-0@lo:501: Request processed in 194us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.614767:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788587031.615134:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879680:0@lo:501: 00000100:00100000:3.0:1788587031.615217:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879808:0@lo:503: 00000100:00100000:3.0:1788587031.615255:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.615308:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587031.615350:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309879808 00000100:00100000:1.0:1788587031.615355:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309879808 00000100:00100000:0.0:1788587031.615400:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788587031.615409:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309879808:12345-0@lo:503: 00000100:00100000:0.0:1788587031.615663:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309879808:12345-0@lo:503: Request processed in 255us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.615670:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788587031.615736:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309879808:0@lo:503: 00000100:00100000:3.0:1788587031.616213:0:9519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9519:1875469309879936:0@lo:502: 00000100:00100000:3.0:1788587031.616251:0:9519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.616282:0:9519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.616328:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309879936 00000100:00100000:0.0:1788587031.616333:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309879936 00000100:00100000:0.0:1788587031.616363:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788587031.616369:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:9519:x1875469309879936:12345-0@lo:502: 00000100:00100000:0.0:1788587031.616827:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:9519:x1875469309879936:12345-0@lo:502: Request processed in 457us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.616835:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788587031.617302:0:9519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9519:1875469309879936:0@lo:502: 00000020:01000000:3.0:1788587031.617329:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587031.617337:0:9519:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:3.0:1788587031.617344:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587031.617346:0:9519:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788587031.617353:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587031.617357:0:9519:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:3.0:1788587031.617377:0:9519:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788587031.617381:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587031.617395:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8cbe044f0000) 00000020:00000080:3.0:1788587031.617417:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788587031.617422:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587031.617506:0:9519:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788587031.617511:0:9519:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788587031.617519:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f634379e 00010000:00080000:3.0:1788587031.617548:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf36b02800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587031.617763:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788587031.618333:0:9519:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788587031.618346:0:9519:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788587031.619311:0:9519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587031.619551:0:9519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587031.619602:0:9519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788587031.619673:0:9519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788587031.620425:0:9520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587031.620430:0:9520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788587031.621315:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587031.621327:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587031.621362:0:9519:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788587031.621386:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f63437a5 00000100:00080000:3.0:1788587031.621396:0:9519:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587031.621402:0:9519:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cbf36b02800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587031.621436:0:9519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe05734000 x1875469309880064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587031.621500:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469309880064:0@lo:8: 00000100:00100000:0.0:1788587031.621565:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788587031.621622:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788587031.621681:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587031.621687:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587031.621689:0:9519:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788587031.621692:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587031.621696:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587031.621697:0:9519:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788587031.621701:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788587031.621703:0:9519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788587031.621727:0:9519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9519:1875469309880192:0@lo:502: 00000100:00100000:3.0:1788587031.621781:0:9519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.621837:0:9519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a9786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.621914:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309880192 00000100:00100000:0.0:1788587031.621920:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309880192 00000100:00100000:0.0:1788587031.621958:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788587031.621967:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:9519:x1875469309880192:12345-0@lo:502: 00000100:00100000:0.0:1788587031.622351:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:9519:x1875469309880192:12345-0@lo:502: Request processed in 384us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.622359:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788587031.622439:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309880320:0@lo:400: 00000100:00100000:3.0:1788587031.622469:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.622488:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587031.622493:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309880448:0@lo:400: 00000100:00100000:3.0:1788587031.622513:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.622549:0:9519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9519:1875469309880192:0@lo:502: 00000020:01000000:3.0:1788587031.622573:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587031.622578:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587031.622585:0:9519:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788587031.622590:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1788587031.622655:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309880576:0@lo:400: 00000100:00100000:3.0:1788587031.622689:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.622716:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309881088:0@lo:400: 00000100:00100000:2.0:1788587031.622733:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309880960:0@lo:400: 00000100:00100000:3.0:1788587031.622742:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.622776:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587031.622789:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309880320 00000100:00100000:0.0:1788587031.622811:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309880320 00000100:00100000:2.0:1788587031.622837:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309881472:0@lo:400: 00000100:00100000:0.0:1788587031.622846:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309880576 00000100:00100000:0.0:1788587031.622850:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309880576 00000100:00100000:0.0:1788587031.622864:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309880960 00000100:00100000:0.0:1788587031.622867:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309880960 00000100:00100000:2.0:1788587031.622872:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.622891:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788587031.622892:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309881472 00000100:00100000:0.0:1788587031.622896:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309881472 00000100:00100000:2.0:1788587031.622899:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309880832:0@lo:400: 00000100:00100000:0.0:1788587031.622912:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587031.622920:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309880320:12345-0@lo:400: 00000100:00100000:2.0:1788587031.622946:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.622965:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309881344:0@lo:400: 00000100:00100000:0.0:1788587031.622971:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309880320:12345-0@lo:400: Request processed in 49us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.622979:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587031.622991:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309880832 00000100:00100000:0.0:1788587031.622995:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309880832 00000100:00100000:2.0:1788587031.622999:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587031.623013:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309881344 00000100:00100000:0.0:1788587031.623017:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309881344 00000100:00100000:2.0:1788587031.623029:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309880704:0@lo:400: 00000100:00100000:0.0:1788587031.623034:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587031.623040:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309880576:12345-0@lo:400: 00000100:00100000:0.0:1788587031.623065:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309880576:12345-0@lo:400: Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.623137:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587031.623162:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587031.623169:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309880960:12345-0@lo:400: 00000100:00100000:0.0:1788587031.623201:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309880960:12345-0@lo:400: Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.623214:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587031.623225:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587031.623230:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309881472:12345-0@lo:400: 00000100:00100000:0.0:1788587031.623255:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309881472:12345-0@lo:400: Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.623260:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587031.623269:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587031.623274:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309880832:12345-0@lo:400: 00000100:00100000:0.0:1788587031.623298:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309880832:12345-0@lo:400: Request processed in 24us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.623303:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587031.623312:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587031.623317:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309881344:12345-0@lo:400: 00000100:00100000:0.0:1788587031.623345:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309881344:12345-0@lo:400: Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.623352:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587031.623373:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309880448 00000100:00100000:0.0:1788587031.623377:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309880448 00000100:00100000:0.0:1788587031.623405:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788587031.623411:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309880448:12345-0@lo:400: 00000100:00100000:0.0:1788587031.623442:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309880448:12345-0@lo:400: Request processed in 31us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.623448:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788587031.623467:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587031.623470:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000000:0.0:1788587031.623480:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788587031.623511:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788587031.623520:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.623530:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587031.623540:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788587031.623542:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf11802800 from 39 10000000:01000000:0.0:1788587031.623545:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587031.623572:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.623585:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587031.623595:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587031.623608:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309881600:0@lo:101: 00000100:00100000:0.0:1788587031.623636:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587031.623660:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083f06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.623738:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.623768:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309881216:0@lo:400: 00000100:00100000:0.0:1788587031.623776:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309880704 00000100:00100000:0.0:1788587031.623781:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309880704 00000100:00100000:0.0:1788587031.623832:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587031.623840:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309880448:0@lo:400: 00000100:00100000:0.0:1788587031.623841:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309880704:12345-0@lo:400: 00010000:00080000:2.0:1788587031.623860:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9d500 x1875469309880320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.623872:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309880320:0@lo:400: 00000100:00100000:0.0:1788587031.623886:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309880704:12345-0@lo:400: Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.623894:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788587031.624014:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0586c380 x1875469309880576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587031.624024:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309880576:0@lo:400: 00000100:00100000:1.0:1788587031.624048:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309880064 00000100:00100000:1.0:1788587031.624054:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309880064 00010000:00080000:2.0:1788587031.624138:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372e680 x1875469309880832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.624148:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309880832:0@lo:400: 00010000:00080000:2.0:1788587031.624171:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372fb80 x1875469309881344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.624179:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309881344:0@lo:400: 00010000:00080000:2.0:1788587031.624188:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372c000 x1875469309880960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.624196:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309880960:0@lo:400: 00010000:00080000:2.0:1788587031.624205:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372f100 x1875469309881472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.624212:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309881472:0@lo:400: 00000100:00100000:2.0:1788587031.624247:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.624859:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309881600 00000100:00100000:3.0:1788587031.624865:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309881600 00000100:00100000:3.0:1788587031.624902:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587031.624911:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309881600:12345-0@lo:101: 00010000:00010000:3.0:1788587031.624922:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587031.624938:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63437ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.624964:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.624976:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.624985:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482c00, rc 0) 00000100:00100000:3.0:1788587031.625036:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309881600:12345-0@lo:101: Request processed in 126us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.625042:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587031.625225:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309881600:0@lo:101: 00010000:00010000:3.0:1788587031.625251:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.625262:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.625319:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309881728:0@lo:501: 00000100:00100000:3.0:1788587031.625349:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.625373:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309881728 00000100:00100000:3.0:1788587031.625376:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309881728 00000100:00100000:3.0:1788587031.625398:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788587031.625404:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309881728:12345-0@lo:501: 00000100:00100000:3.0:1788587031.625645:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309881728:12345-0@lo:501: Request processed in 240us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.625653:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788587031.625686:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.625698:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309881728:0@lo:501: 00000100:00100000:3.0:1788587031.625723:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309881856:0@lo:503: 00000100:00100000:3.0:1788587031.625762:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.625775:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.625788:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309881856 00000100:00100000:3.0:1788587031.625791:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309881856 00000100:00100000:3.0:1788587031.625834:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788587031.625842:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309881856:12345-0@lo:503: 00000100:00100000:3.0:1788587031.626346:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309881856:12345-0@lo:503: Request processed in 504us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.626353:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788587031.626400:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309881856:0@lo:503: 00000100:00100000:3.0:1788587031.626565:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9522:1875469309881984:0@lo:502: 00000100:00100000:3.0:1788587031.626595:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.626612:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309881984 00000100:00100000:3.0:1788587031.626616:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309881984 00000100:00100000:3.0:1788587031.626634:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788587031.626640:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:9522:x1875469309881984:12345-0@lo:502: 00000100:00100000:3.0:1788587031.626772:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:9522:x1875469309881984:12345-0@lo:502: Request processed in 131us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.626778:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788587031.626824:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.626834:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9522:1875469309881984:0@lo:502: 00000100:00100000:3.0:1788587031.626867:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9522:1875469309882112:0@lo:502: 00000100:00100000:3.0:1788587031.626893:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.626908:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309882112 00000100:00100000:3.0:1788587031.626911:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309882112 00000100:00100000:3.0:1788587031.626927:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788587031.626932:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:9522:x1875469309882112:12345-0@lo:502: 00000100:00100000:3.0:1788587031.627044:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:9522:x1875469309882112:12345-0@lo:502: Request processed in 110us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.627050:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788587031.627149:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.627226:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9522:1875469309882112:0@lo:502: 00000040:00080000:3.0:1788587031.627245:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788587031.627293:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788587031.627316:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587031.627326:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.627335:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587031.627343:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587031.627346:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf11802800 from 6 10000000:01000000:3.0:1788587031.627350:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587031.627374:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.627381:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.627390:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.627402:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882240:0@lo:101: 00000100:00100000:3.0:1788587031.627428:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.627440:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.627452:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309882240 00000100:00100000:3.0:1788587031.627455:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309882240 00000100:00100000:3.0:1788587031.627477:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788587031.627483:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309882240:12345-0@lo:101: 00010000:00010000:3.0:1788587031.627490:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587031.627502:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf00030c00/0x419e1ae1f63437c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63437ba expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.627530:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf00030c00/0x419e1ae1f63437c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63437ba expref: 22 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.627541:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf00030c00/0x419e1ae1f63437c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63437ba expref: 22 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.627551:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00030c00, rc 0) 00000100:00100000:3.0:1788587031.627580:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309882240:12345-0@lo:101: Request processed in 98us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.627586:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788587031.627623:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882240:0@lo:101: 00010000:00010000:3.0:1788587031.627634:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.627642:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.627681:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882368:0@lo:256: 00000100:00100000:3.0:1788587031.627708:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.627719:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.627729:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309882368 00000100:00100000:3.0:1788587031.627732:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309882368 00000100:00100000:3.0:1788587031.627748:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788587031.627752:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309882368:12345-0@lo:256: 20000000:01000000:3.0:1788587031.627764:0:6467:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788587031.627780:0:6467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788587031.627783:0:6467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788587031.627880:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309882368:12345-0@lo:256: Request processed in 127us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.627887:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788587031.627916:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882368:0@lo:256: 10000000:01000000:3.0:1788587031.627956:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587031.627962:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.627969:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587031.627975:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788587031.627977:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788587031.627979:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788587031.627995:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.628001:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.628007:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.628018:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882496:0@lo:101: 00000100:00100000:3.0:1788587031.628042:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.628056:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.628067:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309882496 00000100:00100000:3.0:1788587031.628233:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309882496 00000100:00100000:3.0:1788587031.628264:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788587031.628272:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309882496:12345-0@lo:101: 00010000:00010000:3.0:1788587031.628286:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788587031.628290:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309881088 00010000:00010000:3.0:1788587031.628296:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63437c8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587031.628298:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309881088 00010000:00010000:3.0:1788587031.628316:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.628324:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.628331:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00030200, rc 0) 00000100:00100000:3.0:1788587031.628360:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309882496:12345-0@lo:101: Request processed in 89us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.628365:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788587031.628394:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882496:0@lo:101: 00010000:00010000:3.0:1788587031.628404:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.628411:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.628449:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882624:0@lo:501: 00000100:00100000:3.0:1788587031.628473:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.628495:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.628509:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309882624 00000100:00100000:3.0:1788587031.628512:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309882624 00000100:00100000:1.0:1788587031.628522:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309881216 00000100:00100000:1.0:1788587031.628528:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309881216 00000100:00100000:3.0:1788587031.628537:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788587031.628587:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587031.628595:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05734700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309881088:12345-0@lo:400: 00000100:00100000:2.0:1788587031.628639:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05734700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309881088:12345-0@lo:400: Request processed in 45us (5900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.628646:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587031.628659:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587031.628664:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3471:x1875469309880064:12345-0@lo:8: 00010000:00080000:2.0:1788587031.628686:0:8101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1788587031.628709:0:8101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f63437d6 00002000:00100000:2.0:1788587031.628729:0:8101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8cbf3bdd5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788587031.628733:0:8101:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788587031.628738:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788587031.628869:0:8101:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788587031.629196:0:8101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788587031.629220:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdd6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587031.629267:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469309880064:12345-0@lo:8: Request processed in 601us (7702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.629274:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788587031.629312:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372ed80 x1875469309881088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.629506:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309881088:0@lo:400: 00000100:00100000:3.0:1788587031.629578:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309882624:12345-0@lo:501: 00000100:00100000:3.0:1788587031.629831:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309882624:12345-0@lo:501: Request processed in 1286us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.629840:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788587031.629878:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882624:0@lo:501: 00000100:00100000:3.0:1788587031.629908:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882752:0@lo:503: 00000100:00100000:3.0:1788587031.629950:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.629974:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.629987:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309882752 00000100:00100000:3.0:1788587031.629992:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309882752 00000100:00100000:3.0:1788587031.630022:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788587031.630030:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309882752:12345-0@lo:503: 00000100:00100000:1.0:1788587031.630062:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587031.630072:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309881216:12345-0@lo:400: 00000100:00100000:1.0:1788587031.630115:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309881216:12345-0@lo:400: Request processed in 45us (5867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587031.630127:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788587031.630147:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788587031.630186:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05734000 x1875469309880064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.630196:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587031.630202:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788587031.630211:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587031.630216:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788587031.630219:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf36b02800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788587031.630235:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587031.630240:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469309880064:0@lo:8: 00010000:00080000:2.0:1788587031.630274:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372ca80 x1875469309881216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.630283:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309881216:0@lo:400: 00000100:00100000:2.0:1788587031.630302:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309880704:0@lo:400: 00000004:00080000:1.0:1788587031.630305:0:9520:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788587031.630412:0:9520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 229379616621ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788587031.630457:0:9521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9521:1875469309882880:0@lo:700: 00000100:00100000:1.0:1788587031.630499:0:9521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.630515:0:9521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.630581:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309882880 00000100:00100000:2.0:1788587031.630585:0:8108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309882880 00000100:00100000:2.0:1788587031.630623:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587031.630630:0:8108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9521:x1875469309882880:12345-0@lo:700: 00000100:00100000:2.0:1788587031.630778:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8108:1875469309883008:0@lo:700: 00000100:00100000:2.0:1788587031.630828:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.630845:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.631440:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309883008 00000100:00100000:2.0:1788587031.631447:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309883008 00000100:00100000:2.0:1788587031.631489:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587031.631498:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8108:x1875469309883008:12345-0@lo:700: 00000100:00100000:3.0:1788587031.631569:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309882752:12345-0@lo:503: Request processed in 1537us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.631579:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788587031.631637:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309882752:0@lo:503: 00000100:00080000:2.0:1788587031.632955:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587031.633915:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9523:1875469309883136:0@lo:502: 00000100:00100000:1.0:1788587031.634073:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.634221:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.634232:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309883136 00000100:00100000:3.0:1788587031.634240:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309883136 00000100:00100000:3.0:1788587031.634285:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788587031.634293:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:9523:x1875469309883136:12345-0@lo:502: 00000100:00100000:3.0:1788587031.634592:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:9523:x1875469309883136:12345-0@lo:502: Request processed in 298us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.634601:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788587031.634634:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9523:1875469309883136:0@lo:502: 00000020:01000000:1.0:1788587031.634720:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587031.634727:0:9523:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788587031.634734:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587031.634737:0:9523:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788587031.634741:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788587031.634745:0:9523:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:1.0:1788587031.634766:0:9523:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788587031.634768:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587031.634780:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cbf3b88b380) 00000020:00000080:1.0:1788587031.634832:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788587031.634839:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788587031.634911:0:9523:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788587031.634927:0:9523:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788587031.634934:0:9523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63437e4 00010000:00080000:1.0:1788587031.634974:0:9523:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe03e1a000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587031.635381:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788587031.635672:0:9523:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788587031.635683:0:9523:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788587031.636397:0:9523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587031.636599:0:9523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587031.637046:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788587031.637119:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788587031.640440:0:9525:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587031.640447:0:9525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788587031.640652:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587031.640664:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587031.640693:0:9523:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788587031.640720:0:9523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f63437eb 00000100:00080000:3.0:1788587031.640738:0:9523:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587031.640744:0:9523:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbe03e1a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587031.640780:0:9523:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe05734e00 x1875469309883264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587031.640816:0:9523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788587031.640868:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587031.640872:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587031.640874:0:9523:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788587031.640877:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587031.640881:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587031.640882:0:9523:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788587031.640884:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788587031.640886:0:9523:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788587031.640912:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9523:1875469309883392:0@lo:502: 00000100:00100000:3.0:1788587031.640983:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.641018:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.643253:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309883264:0@lo:8: 00000100:00100000:2.0:1788587031.643336:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.643426:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309883264 00000100:00100000:2.0:1788587031.643435:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309883264 00000100:00100000:2.0:1788587031.643469:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587031.643477:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469309883264:12345-0@lo:8: 00010000:00080000:2.0:1788587031.643508:0:8100:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1788587031.643536:0:8100:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f63437f2 00002000:00100000:2.0:1788587031.643548:0:8100:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cbf3bdd0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788587031.643552:0:8100:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788587031.643555:0:8100:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788587031.643641:0:8100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788587031.643666:0:8100:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdd1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587031.643713:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469309883264:12345-0@lo:8: Request processed in 235us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.643725:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788587031.643764:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05734e00 x1875469309883264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.643775:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587031.643782:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788587031.643788:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587031.643815:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788587031.643818:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788587031.643831:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587031.643835:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309883264:0@lo:8: 00000004:00080000:2.0:1788587031.643907:0:9525:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788587031.643984:0:9525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 229393189452ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788587031.644267:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309883392 00000100:00100000:1.0:1788587031.644273:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309883392 00000100:00100000:1.0:1788587031.644316:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788587031.644325:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:9523:x1875469309883392:12345-0@lo:502: 00000100:00100000:1.0:1788587031.644594:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:9523:x1875469309883392:12345-0@lo:502: Request processed in 270us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587031.644602:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788587031.645268:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9523:1875469309883392:0@lo:502: 00000020:01000000:3.0:1788587031.645299:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587031.645309:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587031.645312:0:9523:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788587031.645317:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1788587031.645374:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788587031.645398:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788587031.645407:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.645418:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587031.645429:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788587031.645437:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbf053a99c0 from 1 10000000:01000000:3.0:1788587031.645440:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788587031.645537:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.645546:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.645555:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.645572:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309883520:0@lo:101: 00000100:00100000:3.0:1788587031.645610:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.645643:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587031.645871:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309883520 00000100:00100000:1.0:1788587031.645877:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309883520 00000100:00100000:1.0:1788587031.646031:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788587031.646042:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309883520:12345-0@lo:101: 00010000:00010000:1.0:1788587031.646054:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587031.646067:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63437f9 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.646091:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.646104:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.646113:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd000, rc 0) 00000100:00100000:1.0:1788587031.646150:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309883520:12345-0@lo:101: Request processed in 111us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587031.646179:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788587031.646476:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309883520:0@lo:101: 00010000:00010000:3.0:1788587031.646492:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.646502:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587031.646553:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309883648:0@lo:501: 00000100:00100000:3.0:1788587031.646588:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.646613:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587031.646626:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309883648 00000100:00100000:1.0:1788587031.646632:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309883648 00000100:00100000:1.0:1788587031.646662:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788587031.646704:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309883648:12345-0@lo:501: 00000100:00100000:1.0:1788587031.647246:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309883648:12345-0@lo:501: Request processed in 575us (656us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587031.647255:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788587031.647557:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309883648:0@lo:501: 10000000:01000000:3.0:1788587031.647594:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788587031.647602:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.647628:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:2.0:1788587031.674304:0:6479:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788587031.680853:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8108:x1875469309883008:12345-0@lo:700: Request processed in 49350us (50016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.680868:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788587031.681144:0:8108:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf03638700 x1875469309883008/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.681171:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8108:1875469309883008:0@lo:700: 40000000:02000000:2.0:1788587031.681185:0:8108:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:3.0:1788587031.690088:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1788587031.714702:0:9526:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788587031.714732:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9526:1875469309883904:0@lo:7: 00000100:00100000:2.0:1788587031.714774:0:8108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9521:x1875469309882880:12345-0@lo:700: Request processed in 84141us (84272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.714785:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587031.714834:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.714860:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104180 going to sleep for 11 seconds 00000004:00080000:3.0:1788587031.714895:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:1.0:1788587031.714905:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d55180 x1875469309882880/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587031.714920:0:9521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9521:1875469309882880:0@lo:700: 00000001:00100000:3.0:1788587031.714932:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788587031.714940:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788587031.714972:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309883776:0@lo:13: 00000100:00100000:3.0:1788587031.715139:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.715194:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309883904 00000100:00100000:3.0:1788587031.715201:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309883904 00000100:00100000:3.0:1788587031.715510:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587031.715520:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9526:x1875469309883904:12345-0@lo:7: 00000100:00080000:2.0:1788587031.716542:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587031.717169:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309883776 00000100:00100000:0.0:1788587031.717186:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309883776 00000100:00100000:0.0:1788587031.717225:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587031.717233:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309883776:12345-0@lo:13: 00002000:00000024:0.0:1788587031.717257:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788587031.717330:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309883776:12345-0@lo:13: Request processed in 98us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.717336:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788587031.719470:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05735500 x1875469309883776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.719504:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309883776:0@lo:13: 00002000:00080000:3.0:1788587031.725676:0:8449:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788587031.725686:0:8449:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788587031.725785:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9526:x1875469309883904:12345-0@lo:7: Request processed in 10262us (10948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.725817:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788587031.725992:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05737b80 x1875469309883904/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.726006:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9526:1875469309883904:0@lo:7: 00000004:00080000:2.0:1788587031.726018:0:9526:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788587031.726160:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9526:1875469309884032:0@lo:5: 00000100:00100000:2.0:1788587031.726200:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.726230:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.726285:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309884032 00000100:00100000:3.0:1788587031.726292:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309884032 00000100:00100000:3.0:1788587031.726339:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587031.726526:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9526:x1875469309884032:12345-0@lo:5: 00002000:00080000:3.0:1788587031.726566:0:8100:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788587031.726569:0:8100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788587031.726919:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9526:x1875469309884032:12345-0@lo:5: Request processed in 396us (718us total) trans 4294967297 rc 0/0 00010000:00080000:0.0:1788587031.726993:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf03638700 x1875469309884032/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587031.727009:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9526:1875469309884032:0@lo:5: 00000004:00080000:0.0:1788587031.727019:0:9526:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788587031.727046:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9526:1875469309884160:0@lo:700: 00000100:00100000:0.0:1788587031.727086:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587031.727103:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.727304:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587031.727442:0:8109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309884160 00000100:00100000:1.0:1788587031.727448:0:8109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309884160 00000100:00100000:1.0:1788587031.727520:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587031.727528:0:8109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9526:x1875469309884160:12345-0@lo:700: 00000100:00100000:3.0:1788587031.765783:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309884288:0@lo:13: 00000100:00100000:3.0:1788587031.765874:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788587031.765947:0:9521:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788587031.765971:0:9521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9521:1875469309884416:0@lo:7: 00000100:00100000:1.0:1788587031.766203:0:9521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.766230:0:9521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.766284:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309884416 00000100:00100000:3.0:1788587031.766291:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309884416 00000100:00100000:3.0:1788587031.766344:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587031.766353:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9521:x1875469309884416:12345-0@lo:7: 00000100:00100000:2.0:1788587031.768212:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309884288 00000100:00100000:2.0:1788587031.768223:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309884288 00000100:00100000:2.0:1788587031.768268:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587031.768277:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3473:x1875469309884288:12345-0@lo:13: 00002000:00000024:2.0:1788587031.768298:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788587031.768383:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3473:x1875469309884288:12345-0@lo:13: Request processed in 107us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.768390:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788587031.769244:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d55180 x1875469309884288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.769266:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309884288:0@lo:13: 00002000:00080000:3.0:1788587031.772774:0:8099:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788587031.772783:0:8099:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788587031.772903:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9521:x1875469309884416:12345-0@lo:7: Request processed in 6547us (6696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.772915:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788587031.773388:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d57b80 x1875469309884416/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587031.773401:0:9521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9521:1875469309884416:0@lo:7: 00000004:00080000:1.0:1788587031.773414:0:9521:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788587031.773445:0:9521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9521:1875469309884544:0@lo:5: 00000100:00100000:1.0:1788587031.773486:0:9521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.773512:0:9521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.773566:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309884544 00000100:00100000:2.0:1788587031.773572:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309884544 00000100:00100000:2.0:1788587031.773613:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587031.773621:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9521:x1875469309884544:12345-0@lo:5: 00002000:00080000:2.0:1788587031.773643:0:8101:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788587031.773687:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9521:x1875469309884544:12345-0@lo:5: Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.773693:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788587031.773828:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d57b80 x1875469309884544/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587031.773838:0:9521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9521:1875469309884544:0@lo:5: 00000004:00080000:1.0:1788587031.773846:0:9521:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788587031.773869:0:9521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9521:1875469309884672:0@lo:5: 00000100:00100000:1.0:1788587031.773890:0:9521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.773905:0:9521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587031.773957:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309884672 00000100:00100000:2.0:1788587031.773961:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309884672 00000100:00100000:2.0:1788587031.773994:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587031.774000:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9521:x1875469309884672:12345-0@lo:5: 00002000:00080000:2.0:1788587031.774023:0:8449:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788587031.778313:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9521:x1875469309884672:12345-0@lo:5: Request processed in 4305us (4414us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788587031.778326:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788587031.779128:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d57b80 x1875469309884672/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587031.779148:0:9521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9521:1875469309884672:0@lo:5: 00000004:00080000:1.0:1788587031.779170:0:9521:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788587031.779210:0:9521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9521:1875469309884800:0@lo:900: 00000100:00100000:1.0:1788587031.779248:0:9521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.779277:0:9521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587031.779337:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309884800 00000100:00100000:0.0:1788587031.779343:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309884800 00000100:00100000:0.0:1788587031.779395:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587031.779405:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9521:x1875469309884800:12345-0@lo:900: 00000100:00100000:0.0:1788587031.779455:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9521:x1875469309884800:12345-0@lo:900: Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.779461:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788587031.779660:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d57480 x1875469309884800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587031.779671:0:9521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9521:1875469309884800:0@lo:900: 00000100:00100000:2.0:1788587031.784463:0:8109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9526:x1875469309884160:12345-0@lo:700: Request processed in 56926us (57366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.784478:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788587031.784532:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fddf80 x1875469309884160/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.784548:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9526:1875469309884160:0@lo:700: 00000001:00080000:3.0:1788587031.785007:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:2.0:1788587031.811988:0:9526:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788587031.815902:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9526:1875469309884928:0@lo:5: 00000100:00100000:2.0:1788587031.815970:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587031.816141:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3ccd7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587031.816296:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309884928 00000100:00100000:3.0:1788587031.816303:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309884928 00000100:00100000:3.0:1788587031.816457:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587031.816468:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9526:x1875469309884928:12345-0@lo:5: 00002000:00080000:3.0:1788587031.821672:0:8101:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788587031.821692:0:8101:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788587031.825126:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9526:x1875469309884928:12345-0@lo:5: Request processed in 8653us (9148us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788587031.825139:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788587031.825474:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372ca80 x1875469309884928/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587047 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.825487:0:9526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788587031.825502:0:9526:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbe0372ca80 x1875469309884928/t4294967299(4294967299) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587047 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587031.825514:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9526:1875469309884928:0@lo:5: 00000004:00080000:2.0:1788587031.825535:0:9526:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1788587031.978963:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587033.006535:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587033.131168:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309885184:0@lo:13: 00000100:00100000:0.0:1788587033.131239:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309885056:0@lo:13: 00000100:00100000:1.0:1788587033.131245:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587033.131321:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309885184 00000100:00100000:2.0:1788587033.131329:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309885184 00000100:00100000:2.0:1788587033.131473:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587033.131484:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309885184:12345-0@lo:13: 00002000:00000024:2.0:1788587033.131520:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788587033.131903:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587033.131919:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309885312:0@lo:41: 00000100:00100000:0.0:1788587033.133788:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587033.133964:0:8103:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788587033.133972:0:8103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788587033.134155:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309885056 00000100:00100000:0.0:1788587033.134173:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309885056 00000100:00100000:0.0:1788587033.134349:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587033.134359:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309885056:12345-0@lo:13: 00002000:00000024:0.0:1788587033.134384:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587033.134437:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309885056:12345-0@lo:13: Request processed in 80us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587033.134444:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788587033.134484:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fded80 x1875469309885056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587033.134512:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309885056:0@lo:13: 00000100:00100000:2.0:1788587033.134532:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309885184:12345-0@lo:13: Request processed in 3048us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587033.134541:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788587033.134554:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372f100 x1875469309885184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587033.134569:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309885184:0@lo:13: 00000100:00100000:3.0:1788587033.134638:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788587033.134678:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587033.134680:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309885312 00000100:00100000:0.0:1788587033.134686:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309885312 00000100:00100000:0.0:1788587033.134979:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788587033.134988:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309885312:12345-0@lo:41: 00000004:00000024:0.0:1788587033.135022:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587033.135082:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309885312:12345-0@lo:41: Request processed in 96us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587033.135089:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788587033.135212:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309885312:0@lo:41: 00000100:00100000:2.0:1788587033.643097:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587033.643121:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309885440:0@lo:41: 00000100:00100000:2.0:1788587033.643198:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587033.643224:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309885440 00000100:00100000:1.0:1788587033.643231:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309885440 00000100:00100000:1.0:1788587033.643274:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587033.643283:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309885440:12345-0@lo:41: 00000004:00000024:1.0:1788587033.643321:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587033.643393:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309885440:12345-0@lo:41: Request processed in 111us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587033.643399:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587033.643495:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309885440:0@lo:41: 00010000:00010000:1.0:1788587034.028926:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788587034.250950:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1788587034.250970:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788587034.660470:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587034.662441:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292011648 00000100:00100000:1.0:1788587034.662456:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292011648 00000100:00100000:1.0:1788587034.662507:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 178 00000100:00100000:1.0:1788587034.662515:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2408:x1875469292011648:12345-192.168.203.14@tcp:250: 00010000:00080000:1.0:1788587034.662542:0:6465:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b4b0c77f-670d-4698-a42c-a862f5ca1366@192.168.203.14@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1788587034.662568:0:6465:0:(genops.c:1385:class_connect()) connect: client b4b0c77f-670d-4698-a42c-a862f5ca1366, cookie 0x419e1ae1f6343807 00000100:00080000:1.0:1788587034.662695:0:6465:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bda9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587034.662765:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+5:2408:x1875469292011648:12345-192.168.203.14@tcp:250: Request processed in 249us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.662773:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 178 00000100:00100000:3.0:1788587034.665607:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587034.666285:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292011776 00000100:00100000:2.0:1788587034.666296:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292011776 00000100:00100000:2.0:1788587034.666345:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 179 00000100:00100000:2.0:1788587034.666366:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+5:6369:x1875469292011776:12345-192.168.203.14@tcp:101: 00010000:00010000:2.0:1788587034.666382:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587034.666399:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd569a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.666426:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 6 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.666438:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 6 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.666458:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045e00, rc 0) 00000100:00100000:2.0:1788587034.666511:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+6:6369:x1875469292011776:12345-192.168.203.14@tcp:101: Request processed in 147us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587034.666519:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 179 00000100:00100000:2.0:1788587034.674507:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587034.674588:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292011904 00000100:00100000:3.0:1788587034.674599:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292011904 00000100:00100000:3.0:1788587034.674680:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 180 00000100:00100000:3.0:1788587034.674690:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+6:6369:x1875469292011904:12345-192.168.203.14@tcp:501: 00000100:00100000:3.0:1788587034.675016:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+6:6369:x1875469292011904:12345-192.168.203.14@tcp:501: Request processed in 315us (507us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587034.675025:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 180 00000100:00100000:0.0:1788587034.678674:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587034.678761:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292012032 00000100:00100000:3.0:1788587034.678771:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292012032 00000100:00100000:3.0:1788587034.678841:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 181 00000100:00100000:3.0:1788587034.678852:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+6:6369:x1875469292012032:12345-192.168.203.14@tcp:101: 00010000:00010000:3.0:1788587034.678869:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587034.678885:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd56a1 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.678914:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 7 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.678926:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 7 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.678936:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00031600, rc 0) 00000100:00100000:3.0:1788587034.678997:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+7:6369:x1875469292012032:12345-192.168.203.14@tcp:101: Request processed in 146us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587034.679004:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 181 00000100:00100000:3.0:1788587034.681774:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587034.681818:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292012160 00000100:00100000:0.0:1788587034.681828:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292012160 00000100:00100000:0.0:1788587034.681873:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 182 00000100:00100000:0.0:1788587034.681883:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+7:6369:x1875469292012160:12345-192.168.203.14@tcp:501: 00000100:00100000:0.0:1788587034.682158:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6369:x1875469292012160:12345-192.168.203.14@tcp:501: Request processed in 275us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587034.682167:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 182 00000100:00100000:3.0:1788587034.684994:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587034.685079:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292012288 00000100:00100000:0.0:1788587034.685099:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292012288 00000100:00100000:0.0:1788587034.685168:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 183 00000100:00100000:0.0:1788587034.685179:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6369:x1875469292012288:12345-192.168.203.14@tcp:503: 00000100:00100000:0.0:1788587034.685947:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6369:x1875469292012288:12345-192.168.203.14@tcp:503: Request processed in 765us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587034.685958:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 183 00000100:00100000:3.0:1788587034.688668:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587034.689195:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292012416 00000100:00100000:2.0:1788587034.689209:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292012416 00000100:00100000:2.0:1788587034.689440:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:2.0:1788587034.689452:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6387:x1875469292012416:12345-192.168.203.14@tcp:502: 00000100:00100000:2.0:1788587034.689830:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6387:x1875469292012416:12345-192.168.203.14@tcp:502: Request processed in 378us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587034.689838:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:1.0:1788587034.730943:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587034.731400:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292012544 00000100:00100000:0.0:1788587034.731410:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292012544 00000100:00100000:0.0:1788587034.731467:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:0.0:1788587034.731477:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6387:x1875469292012544:12345-192.168.203.14@tcp:502: 00000100:00100000:0.0:1788587034.731783:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6387:x1875469292012544:12345-192.168.203.14@tcp:502: Request processed in 306us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587034.731790:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:0.0:1788587034.740508:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587034.740562:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292012672 00000100:00100000:3.0:1788587034.740577:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292012672 00000100:00100000:3.0:1788587034.740636:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:3.0:1788587034.740645:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6369:x1875469292012672:12345-192.168.203.14@tcp:101: 00010000:00010000:3.0:1788587034.740660:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587034.740677:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf00031c00/0x419e1ae1f634381c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd56d2 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.740773:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf00031c00/0x419e1ae1f634381c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d2 expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.740785:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf00031c00/0x419e1ae1f634381c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d2 expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.740809:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00031c00, rc 0) 00000100:00100000:3.0:1788587034.740858:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6369:x1875469292012672:12345-192.168.203.14@tcp:101: Request processed in 214us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587034.740864:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:1.0:1788587034.743450:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587034.743546:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292012800 00000100:00100000:3.0:1788587034.743556:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292012800 00000100:00100000:3.0:1788587034.743605:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 187 00000100:00100000:3.0:1788587034.743616:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6369:x1875469292012800:12345-192.168.203.14@tcp:256: 20000000:01000000:3.0:1788587034.743654:0:6464:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788587034.743675:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788587034.743679:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788587034.743682:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788587034.743684:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788587034.743686:0:6464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788587034.745865:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6369:x1875469292012800:12345-192.168.203.14@tcp:256: Request processed in 2241us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587034.745877:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 187 00000100:00100000:2.0:1788587034.750123:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587034.750497:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292012928 00000100:00100000:3.0:1788587034.750506:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292012928 00000100:00100000:3.0:1788587034.750643:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 188 00000100:00100000:3.0:1788587034.750654:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6369:x1875469292012928:12345-192.168.203.14@tcp:101: 00010000:00010000:3.0:1788587034.750671:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587034.750708:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd56d9 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.750742:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 10 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.750755:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 10 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.750763:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105200, rc 0) 00000100:00100000:3.0:1788587034.750828:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6369:x1875469292012928:12345-192.168.203.14@tcp:101: Request processed in 176us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587034.750835:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 188 00000100:00100000:1.0:1788587034.755234:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587034.755443:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292013056 00000100:00100000:2.0:1788587034.755455:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292013056 00000100:00100000:2.0:1788587034.755508:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 189 00000100:00100000:2.0:1788587034.755519:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6369:x1875469292013056:12345-192.168.203.14@tcp:501: 00000100:00100000:2.0:1788587034.755903:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6369:x1875469292013056:12345-192.168.203.14@tcp:501: Request processed in 385us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587034.755912:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 189 00000100:00100000:1.0:1788587034.760742:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587034.760996:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292013184 00000100:00100000:3.0:1788587034.761007:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292013184 00000100:00100000:3.0:1788587034.761145:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 190 00000100:00100000:3.0:1788587034.761157:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6369:x1875469292013184:12345-192.168.203.14@tcp:503: 00000100:00100000:3.0:1788587034.761577:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6369:x1875469292013184:12345-192.168.203.14@tcp:503: Request processed in 420us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587034.761585:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 190 00000100:00100000:0.0:1788587034.765662:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587034.766013:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292013312 00000100:00100000:1.0:1788587034.766024:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292013312 00000100:00100000:1.0:1788587034.766116:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 191 00000100:00100000:1.0:1788587034.766125:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6392:x1875469292013312:12345-192.168.203.14@tcp:502: 00000100:00100000:1.0:1788587034.766391:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6392:x1875469292013312:12345-192.168.203.14@tcp:502: Request processed in 265us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.766400:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 191 00000100:00100000:3.0:1788587034.768988:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587034.769365:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292013440 00000100:00100000:0.0:1788587034.769375:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292013440 00000100:00100000:0.0:1788587034.769421:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 192 00000100:00100000:0.0:1788587034.769432:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6392:x1875469292013440:12345-192.168.203.14@tcp:502: 00000100:00100000:0.0:1788587034.769639:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6392:x1875469292013440:12345-192.168.203.14@tcp:502: Request processed in 209us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587034.769648:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 192 00000100:00100000:1.0:1788587034.776532:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587034.776569:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292013568 00000100:00100000:1.0:1788587034.776577:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292013568 00000100:00100000:1.0:1788587034.776616:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788587034.776624:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875469292013568:12345-192.168.203.14@tcp:38: 00010000:00080000:1.0:1788587034.776650:0:6474:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1788587034.776696:0:6474:0:(genops.c:1385:class_connect()) connect: client 12266002-a8db-4050-aa6c-b9db12e6128d, cookie 0x419e1ae1f634382a 00000004:00100000:1.0:1788587034.776722:0:6474:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788587034.777057:0:6474:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdaa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587034.777115:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2408:x1875469292013568:12345-192.168.203.14@tcp:38: Request processed in 490us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.777123:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788587034.781590:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587034.782954:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292013824 00000100:00100000:2.0:1788587034.782977:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292013824 00000100:00100000:2.0:1788587034.783024:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788587034.783032:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875469292013824:12345-192.168.203.14@tcp:38: 00010000:00080000:2.0:1788587034.783059:0:8126:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1788587034.783100:0:8126:0:(genops.c:1385:class_connect()) connect: client 12266002-a8db-4050-aa6c-b9db12e6128d, cookie 0x419e1ae1f6343831 00000004:00100000:2.0:1788587034.783126:0:8126:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587034.783595:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdd7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587034.783692:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2408:x1875469292013824:12345-192.168.203.14@tcp:38: Request processed in 659us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587034.783700:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00010000:00010000:1.0:1788587035.056215:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587035.784740:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587035.784790:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587035.787655:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292013696 00000100:00100000:0.0:1788587035.787669:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292013696 00000100:00080000:3.0:1788587035.787737:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587035.787737:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292014080 00000100:00100000:0.0:1788587035.787751:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292014080 00000100:00100000:0.0:1788587035.787819:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:0.0:1788587035.787831:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:0:x1875469292013696:12345-192.168.203.14@tcp:41: 00000100:00100000:3.0:1788587035.787866:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000004:00000024:0.0:1788587035.787880:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587035.787881:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+7:6369:x1875469292014080:12345-192.168.203.14@tcp:41: 00000004:00000024:3.0:1788587035.787903:0:8126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587035.787962:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:0:x1875469292013696:12345-192.168.203.14@tcp:41: Request processed in 132us (3233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587035.787970:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:3.0:1788587035.793259:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:6369:x1875469292014080:12345-192.168.203.14@tcp:41: Request processed in 5371us (8455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587035.793274:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:1.0:1788587035.793479:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587035.793672:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292013952 00000100:00100000:3.0:1788587035.793681:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292013952 00000100:00100000:3.0:1788587035.794047:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:3.0:1788587035.794058:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:0:x1875469292013952:12345-192.168.203.14@tcp:41: 00000004:00000024:3.0:1788587035.794102:0:8126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587035.794159:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:0:x1875469292013952:12345-192.168.203.14@tcp:41: Request processed in 104us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587035.794166:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00080000:2.0:1788587035.800256:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587035.803273:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587035.803589:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292014208 00000100:00100000:2.0:1788587035.803600:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292014208 00000100:00100000:2.0:1788587035.803667:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788587035.803678:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:6369:x1875469292014208:12345-192.168.203.14@tcp:40: 00000100:00100000:2.0:1788587035.803770:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:6369:x1875469292014208:12345-192.168.203.14@tcp:40: Request processed in 93us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587035.803777:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:0.0:1788587035.806222:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587035.806333:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292014336 00000100:00100000:3.0:1788587035.806356:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292014336 00000100:00100000:3.0:1788587035.806410:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788587035.806419:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1875469292014336:12345-192.168.203.14@tcp:8: 00010000:00080000:3.0:1788587035.806469:0:8099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1788587035.806502:0:8099:0:(genops.c:1385:class_connect()) connect: client 12266002-a8db-4050-aa6c-b9db12e6128d, cookie 0x419e1ae1f6343838 00002000:00100000:3.0:1788587035.806513:0:8099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 12266002-a8db-4050-aa6c-b9db12e6128d/ffff8cbf0493c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587035.806540:0:8099:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587035.807192:0:8099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587035.807225:0:8099:0:(import.c:65:import_set_state_nolock()) ffff8cbf0493c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587035.807486:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2408:x1875469292014336:12345-192.168.203.14@tcp:8: Request processed in 1064us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587035.807494:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:0.0:1788587035.824246:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587035.824300:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587035.824464:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292014464 00000100:00100000:2.0:1788587035.824475:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292014464 00000100:00100000:2.0:1788587035.824524:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587035.824532:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1875469292014464:12345-192.168.203.14@tcp:8: 00010000:00080000:2.0:1788587035.824577:0:8100:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1788587035.824610:0:8100:0:(genops.c:1385:class_connect()) connect: client 12266002-a8db-4050-aa6c-b9db12e6128d, cookie 0x419e1ae1f634383f 00002000:00100000:2.0:1788587035.824622:0:8100:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12266002-a8db-4050-aa6c-b9db12e6128d/ffff8cbf3bdd4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587035.824661:0:8100:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587035.825070:0:8100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788587035.825103:0:8100:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdd7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587035.825173:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2408:x1875469292014464:12345-192.168.203.14@tcp:8: Request processed in 639us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587035.825181:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788587035.829167:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292014592 00000100:00100000:3.0:1788587035.829183:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292014592 00000100:00100000:3.0:1788587035.829297:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788587035.829307:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:12266002-a8db-4050-aa6c-b9db12e6128d+6:6369:x1875469292014592:12345-192.168.203.14@tcp:900: 00000100:00100000:3.0:1788587035.829400:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:12266002-a8db-4050-aa6c-b9db12e6128d+6:6369:x1875469292014592:12345-192.168.203.14@tcp:900: Request processed in 81us (5086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587035.829407:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:1.0:1788587035.830588:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587035.830762:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292014720 00000100:00100000:3.0:1788587035.830838:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292014720 00000100:00100000:3.0:1788587035.830880:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:3.0:1788587035.830889:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2410:x1875469292014720:12345-192.168.203.14@tcp:400: 00000100:00100000:3.0:1788587035.831654:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2410:x1875469292014720:12345-192.168.203.14@tcp:400: Request processed in 759us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587035.831666:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:1.0:1788587035.840210:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587035.841234:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292014848 00000100:00100000:2.0:1788587035.841247:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292014848 00000100:00100000:2.0:1788587035.841324:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:2.0:1788587035.841335:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:6369:x1875469292014848:12345-192.168.203.14@tcp:33: 00000004:00080000:1.0:1788587035.873874:0:6475:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32465us 00000004:00200000:0.0:1788587035.894930:0:6475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788587035.895051:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:6369:x1875469292014848:12345-192.168.203.14@tcp:33: Request processed in 53712us (54845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587035.895064:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00010000:00010000:2.0:1788587036.074952:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587036.106042:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587036.106462:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292014976 00000100:00100000:3.0:1788587036.106472:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292014976 00000100:00100000:3.0:1788587036.106549:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:3.0:1788587036.106560:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:6410:x1875469292014976:12345-192.168.203.14@tcp:101: 00010000:00010000:3.0:1788587036.106583:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587036.106678:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104e00/0x419e1ae1f6343846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd570a expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587036.106743:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f634384d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587036.106757:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f634384d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587036.106773:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f634384d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587036.106855:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587036.106859:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587036.106875:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f634384d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587036.106898:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104e00/0x419e1ae1f6343846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd570a expref: 8 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587036.106917:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f634384d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd570a expref: 7 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587036.106925:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76400) 00010000:00010000:3.0:1788587036.106928:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587036.106932:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37104800, rc 0) 00000100:00100000:3.0:1788587036.107002:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+7:6410:x1875469292014976:12345-192.168.203.14@tcp:101: Request processed in 444us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587036.107015:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:2.0:1788587036.717094:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309885824:0@lo:400: 00000100:00100000:2.0:1788587036.717182:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717247:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309886336:0@lo:400: 00000100:00100000:2.0:1788587036.717273:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717293:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309886848:0@lo:400: 00000100:00100000:2.0:1788587036.717312:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717349:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788587036.717355:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309885952:0@lo:400: 00000100:00100000:2.0:1788587036.717376:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717393:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309886464:0@lo:400: 00000100:00100000:2.0:1788587036.717412:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717444:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309886976:0@lo:400: 00000100:00100000:2.0:1788587036.717464:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717493:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309886336 00000100:00100000:2.0:1788587036.717507:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309886336 00000100:00100000:2.0:1788587036.717557:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309886848 00000100:00100000:2.0:1788587036.717561:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309886848 00000100:00100000:2.0:1788587036.717575:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309885952 00000100:00100000:2.0:1788587036.717577:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309885952 00000100:00100000:2.0:1788587036.717595:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587036.717598:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309885568:0@lo:400: 00000100:00100000:2.0:1788587036.717613:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309886336:12345-0@lo:400: 00000100:00100000:1.0:1788587036.717631:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587036.717657:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309886080:0@lo:400: 00000100:00100000:2.0:1788587036.717659:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309886336:12345-0@lo:400: Request processed in 57us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587036.717666:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587036.717686:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587036.717692:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309886848:12345-0@lo:400: 00000100:00100000:1.0:1788587036.717698:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717717:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309886848:12345-0@lo:400: Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587036.717718:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309886592:0@lo:400: 00000100:00100000:2.0:1788587036.717723:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587036.717735:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587036.717738:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717740:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309885952:12345-0@lo:400: 00000100:00100000:1.0:1788587036.717754:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309887104:0@lo:400: 00000100:00100000:2.0:1788587036.717762:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309885952:12345-0@lo:400: Request processed in 23us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587036.717768:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587036.717776:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717788:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309886464 00000100:00100000:2.0:1788587036.717810:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309886464 00000100:00100000:1.0:1788587036.717815:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788587036.717821:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309885696:0@lo:400: 00000100:00100000:2.0:1788587036.717830:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309886976 00000100:00100000:2.0:1788587036.717833:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309886976 00000100:00100000:2.0:1788587036.717842:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309886592 00000100:00100000:2.0:1788587036.717844:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309886592 00000100:00100000:2.0:1788587036.717854:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309887104 00000100:00100000:1.0:1788587036.717855:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587036.717856:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309887104 00000100:00100000:2.0:1788587036.717868:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587036.717873:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309886208:0@lo:400: 00000100:00100000:1.0:1788587036.717892:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587036.717908:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309886720:0@lo:400: 00000100:00100000:1.0:1788587036.717925:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587036.717950:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309885824 00000100:00100000:1.0:1788587036.717953:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309885824 00000100:00100000:1.0:1788587036.717972:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309886080 00000100:00100000:1.0:1788587036.717974:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309886080 00000100:00100000:1.0:1788587036.717986:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587036.717991:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309885824:12345-0@lo:400: 00000100:00100000:2.0:1788587036.718082:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309886464:12345-0@lo:400: 00000100:00100000:2.0:1788587036.718114:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309886464:12345-0@lo:400: Request processed in 35us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587036.718131:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587036.718143:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587036.718149:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309886976:12345-0@lo:400: 00000100:00100000:2.0:1788587036.718177:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309886976:12345-0@lo:400: Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587036.718182:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587036.718192:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587036.718198:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309886592:12345-0@lo:400: 00000100:00100000:2.0:1788587036.718228:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309886592:12345-0@lo:400: Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587036.718234:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587036.718244:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587036.718250:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309887104:12345-0@lo:400: 00000100:00100000:2.0:1788587036.718273:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309887104:12345-0@lo:400: Request processed in 24us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587036.718278:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788587036.718294:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587036.718298:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587036.718301:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587036.718310:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309885568 00000100:00100000:2.0:1788587036.718314:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309885568 00000100:00100000:1.0:1788587036.718399:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309885824:12345-0@lo:400: Request processed in 407us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587036.718406:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587036.718426:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587036.718432:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309886080:12345-0@lo:400: 00000100:00100000:1.0:1788587036.718460:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309886080:12345-0@lo:400: Request processed in 29us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587036.718465:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587036.718496:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309885696 00000100:00100000:1.0:1788587036.718500:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309885696 00000100:00100000:1.0:1788587036.718516:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309886208 00000100:00100000:1.0:1788587036.718518:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309886208 00000100:00100000:1.0:1788587036.718535:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309886720 00000100:00100000:1.0:1788587036.718537:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309886720 00000100:00100000:1.0:1788587036.718550:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587036.718556:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309885696:12345-0@lo:400: 00000100:00100000:1.0:1788587036.718717:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309885696:12345-0@lo:400: Request processed in 160us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587036.718724:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587036.718737:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587036.718743:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309886208:12345-0@lo:400: 00000100:00100000:1.0:1788587036.718771:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309886208:12345-0@lo:400: Request processed in 28us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587036.718777:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587036.718790:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587036.718874:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788587036.719022:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309885568:12345-0@lo:400: 00000100:00100000:2.0:1788587036.719056:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309885568:12345-0@lo:400: Request processed in 45us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587036.719068:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788587036.719145:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309885952:0@lo:400: 00010000:00080000:2.0:1788587036.719160:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a50380 x1875469309886464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587036.719170:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309886464:0@lo:400: 00010000:00080000:2.0:1788587036.719180:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a51c00 x1875469309886976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587036.719187:0:3472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788587036.719201:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309886976:0@lo:400: 00000100:00100000:2.0:1788587036.719212:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309885824:0@lo:400: 00010000:00080000:2.0:1788587036.719222:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a51f80 x1875469309886336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587036.719230:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309886336:0@lo:400: 00010000:00080000:2.0:1788587036.719240:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a52300 x1875469309886848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587036.719248:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309886848:0@lo:400: 00000100:00100000:2.0:1788587036.719317:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309885696:0@lo:400: 00000100:00100000:2.0:1788587036.719327:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309886208:0@lo:400: 00000100:00080000:0.0:1788587036.719466:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587036.719537:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309885568:0@lo:400: 00000100:00100000:2.0:1788587036.719552:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309886080:0@lo:400: 00000100:00100000:1.0:1788587036.719561:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309886720:12345-0@lo:400: 00010000:00080000:2.0:1788587036.719563:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a52d80 x1875469309886592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587036.719578:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309886592:0@lo:400: 00010000:00080000:2.0:1788587036.719591:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a53100 x1875469309887104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587036.719597:0:3474:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788587036.719678:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309887104:0@lo:400: 00000100:00100000:1.0:1788587036.720442:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309886720:12345-0@lo:400: Request processed in 1644us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587036.720451:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587036.720541:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309886720:0@lo:400: 00010000:00010000:2.0:1788587037.099661:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587037.227953:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309887232:0@lo:13: 00000100:00100000:1.0:1788587037.228033:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587037.229021:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309887232 00000100:00100000:0.0:1788587037.229029:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309887232 00000100:00100000:0.0:1788587037.229089:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587037.229099:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309887232:12345-0@lo:13: 00002000:00000024:0.0:1788587037.229130:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587037.229189:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309887232:12345-0@lo:13: Request processed in 94us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587037.229196:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788587037.229237:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd50e00 x1875469309887232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587037.229255:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309887232:0@lo:13: 00000100:00100000:0.0:1788587037.229284:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587037.229304:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309887360:0@lo:13: 00000100:00100000:0.0:1788587037.229332:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587037.229358:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309887360 00000100:00100000:0.0:1788587037.229361:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309887360 00000100:00100000:0.0:1788587037.229383:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587037.229389:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309887360:12345-0@lo:13: 00002000:00000024:0.0:1788587037.229399:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587037.229426:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309887360:12345-0@lo:13: Request processed in 37us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587037.229433:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788587037.229455:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a53480 x1875469309887360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587037.229467:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309887360:0@lo:13: 00000001:00100000:0.0:1788587037.273956:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000001:00100000:3.0:1788587037.288987:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000100:00100000:2.0:1788587037.998899:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587037.999069:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292015104 00000100:00100000:1.0:1788587037.999078:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292015104 00000100:00100000:1.0:1788587037.999189:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:1.0:1788587037.999210:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:6463:x1875469292015104:12345-192.168.203.14@tcp:41: 00000004:00000024:1.0:1788587037.999303:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587037.999421:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:6463:x1875469292015104:12345-192.168.203.14@tcp:41: Request processed in 212us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587037.999428:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00080000:0.0:1788587037.999526:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587038.004277:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587038.004833:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292015232 00000100:00100000:2.0:1788587038.004845:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292015232 00000100:00100000:2.0:1788587038.004926:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:2.0:1788587038.004937:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:6463:x1875469292015232:12345-192.168.203.14@tcp:41: 00000004:00000024:2.0:1788587038.004980:0:8126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587038.005054:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:6463:x1875469292015232:12345-192.168.203.14@tcp:41: Request processed in 118us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587038.005062:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00080000:0.0:1788587038.005320:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587038.007567:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587038.007893:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292015360 00000100:00100000:0.0:1788587038.007903:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292015360 00000100:00100000:0.0:1788587038.007986:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:0.0:1788587038.007998:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12266002-a8db-4050-aa6c-b9db12e6128d+6:6463:x1875469292015360:12345-192.168.203.14@tcp:13: 00002000:00000024:0.0:1788587038.008038:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587038.008106:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12266002-a8db-4050-aa6c-b9db12e6128d+6:6463:x1875469292015360:12345-192.168.203.14@tcp:13: Request processed in 111us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587038.008123:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00080000:2.0:1788587038.009176:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587038.013067:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587038.014242:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292015488 00000100:00100000:0.0:1788587038.014254:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292015488 00000100:00100000:0.0:1788587038.014436:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:0.0:1788587038.014448:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12266002-a8db-4050-aa6c-b9db12e6128d+6:6463:x1875469292015488:12345-192.168.203.14@tcp:13: 00002000:00000024:0.0:1788587038.014489:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587038.014562:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12266002-a8db-4050-aa6c-b9db12e6128d+6:6463:x1875469292015488:12345-192.168.203.14@tcp:13: Request processed in 117us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587038.014570:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00080000:2.0:1788587038.014866:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788587038.124483:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587038.251049:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587038.251073:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309887488:0@lo:13: 00000100:00100000:0.0:1788587038.251166:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587038.251215:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587038.251229:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309887616:0@lo:41: 00000100:00100000:3.0:1788587038.251267:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587038.251358:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309887488 00000100:00100000:1.0:1788587038.251366:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309887488 00000100:00100000:1.0:1788587038.251422:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587038.251432:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309887488:12345-0@lo:13: 00002000:00000024:1.0:1788587038.251455:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788587038.251476:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587038.251508:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309887488:12345-0@lo:13: Request processed in 77us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587038.251516:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788587038.251534:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdea00 x1875469309887488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587038.251557:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309887488:0@lo:13: 00000100:00100000:0.0:1788587038.251590:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309887616 00000100:00100000:0.0:1788587038.251595:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309887616 00000100:00100000:0.0:1788587038.251628:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788587038.251634:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309887616:12345-0@lo:41: 00000004:00000024:0.0:1788587038.251651:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587038.251691:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309887616:12345-0@lo:41: Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587038.251697:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587038.252199:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309887616:0@lo:41: 00000100:00100000:1.0:1788587038.253535:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587038.253555:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309887744:0@lo:13: 00000100:00100000:1.0:1788587038.253611:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587038.254293:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309887744 00000100:00100000:0.0:1788587038.254301:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309887744 00000100:00080000:3.0:1788587038.254432:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587038.254492:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587038.254503:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309887744:12345-0@lo:13: 00002000:00000024:0.0:1788587038.254530:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587038.254591:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309887744:12345-0@lo:13: Request processed in 91us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587038.254598:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788587038.254648:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372ca80 x1875469309887744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587038.254672:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309887744:0@lo:13: 00000100:00100000:0.0:1788587038.763042:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587038.763062:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309887872:0@lo:41: 00000100:00100000:0.0:1788587038.763146:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587038.763202:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309887872 00000100:00100000:0.0:1788587038.763210:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309887872 00000100:00100000:0.0:1788587038.763252:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587038.763260:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309887872:12345-0@lo:41: 00000004:00000024:0.0:1788587038.763297:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587038.763341:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309887872:12345-0@lo:41: Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587038.763347:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587038.763593:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309887872:0@lo:41: 00000001:00100000:0.0:1788587038.805249:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00010000:00010000:2.0:1788587039.147016:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587040.087241:0:9736:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788587040.171121:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587040.423249:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000100:00100000:3.0:1788587040.922972:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587040.923021:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587040.923060:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587040.923082:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587040.923122:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587040.923149:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292015744 00000100:00100000:3.0:1788587040.923158:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292015744 00000100:00100000:3.0:1788587040.923217:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292015872 00000100:00100000:3.0:1788587040.923221:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292015872 00000100:00100000:3.0:1788587040.923247:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:3.0:1788587040.923259:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292015744:12345-192.168.203.14@tcp:400: 00000100:00100000:1.0:1788587040.923963:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292015616 00000100:00100000:1.0:1788587040.923970:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292015616 00000100:00100000:1.0:1788587040.924018:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:1.0:1788587040.924027:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292015616:12345-192.168.203.14@tcp:400: 00000100:00100000:0.0:1788587040.924070:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292016000 00000100:00100000:0.0:1788587040.924074:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292016000 00000100:00100000:1.0:1788587040.924109:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292015616:12345-192.168.203.14@tcp:400: Request processed in 83us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587040.924113:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292016128 00000100:00100000:0.0:1788587040.924116:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292016128 00000100:00100000:1.0:1788587040.924117:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:0.0:1788587040.924136:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:0.0:1788587040.924143:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292016000:12345-192.168.203.14@tcp:400: 00000100:00100000:1.0:1788587040.924155:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:0.0:1788587040.924172:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292016000:12345-192.168.203.14@tcp:400: Request processed in 31us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587040.924175:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292016128:12345-192.168.203.14@tcp:400: 00000100:00100000:0.0:1788587040.924179:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:1.0:1788587040.924199:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292016128:12345-192.168.203.14@tcp:400: Request processed in 25us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587040.924205:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00080000:0.0:1788587040.924212:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587040.924216:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587040.924219:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587040.924222:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587040.924228:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:1.0:1788587040.924235:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292015872:12345-192.168.203.14@tcp:400: 00000100:00100000:1.0:1788587040.924259:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292015872:12345-192.168.203.14@tcp:400: Request processed in 25us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587040.924266:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:2.0:1788587040.926897:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292015744:12345-192.168.203.14@tcp:400: Request processed in 3630us (3865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587040.927245:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00010000:00010000:1.0:1788587041.196597:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587041.835176:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309888384:0@lo:400: 00000100:00100000:0.0:1788587041.835238:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835285:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309888896:0@lo:400: 00000100:00100000:0.0:1788587041.835329:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835354:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309889408:0@lo:400: 00000100:00100000:0.0:1788587041.835373:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835395:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788587041.835401:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309888000:0@lo:400: 00000100:00100000:0.0:1788587041.835425:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835444:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309888512:0@lo:400: 00000100:00100000:0.0:1788587041.835465:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835481:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309889024:0@lo:400: 00000100:00100000:0.0:1788587041.835500:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835516:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309889536:0@lo:400: 00000100:00100000:0.0:1788587041.835534:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835558:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309888128:0@lo:400: 00000100:00100000:0.0:1788587041.835580:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835595:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309888640:0@lo:400: 00000100:00100000:0.0:1788587041.835612:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835628:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309889152:0@lo:400: 00000100:00100000:0.0:1788587041.835648:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835665:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788587041.835671:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309888256:0@lo:400: 00000100:00100000:0.0:1788587041.835700:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835720:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309888768:0@lo:400: 00000100:00100000:0.0:1788587041.835741:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835751:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309889280:0@lo:400: 00000100:00100000:0.0:1788587041.835769:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587041.835829:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309888384 00000100:00100000:0.0:1788587041.835837:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309888384 00000100:00100000:0.0:1788587041.835872:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309888128 00000100:00100000:0.0:1788587041.835875:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309888128 00000100:00100000:0.0:1788587041.835885:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309888640 00000100:00100000:0.0:1788587041.835888:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309888640 00000100:00100000:0.0:1788587041.835909:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309889152 00000100:00100000:0.0:1788587041.835911:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309889152 00000100:00100000:0.0:1788587041.835922:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309888768 00000100:00100000:0.0:1788587041.835925:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309888768 00000100:00100000:0.0:1788587041.835937:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309889280 00000100:00100000:0.0:1788587041.835940:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309889280 00000100:00100000:0.0:1788587041.835954:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788587041.835962:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309888384:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836028:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309888384:12345-0@lo:400: Request processed in 66us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836035:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788587041.836052:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788587041.836058:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309888128:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836283:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309888128:12345-0@lo:400: Request processed in 224us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836290:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788587041.836359:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587041.836366:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309888640:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836395:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309888640:12345-0@lo:400: Request processed in 30us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836402:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587041.836413:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587041.836418:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309889152:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836456:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309889152:12345-0@lo:400: Request processed in 38us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836462:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587041.836475:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587041.836481:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309888768:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836505:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309888768:12345-0@lo:400: Request processed in 25us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836511:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587041.836522:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788587041.836527:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309889280:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836553:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309889280:12345-0@lo:400: Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836559:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788587041.836580:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309888896 00000100:00100000:0.0:1788587041.836584:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309888896 00000100:00100000:0.0:1788587041.836604:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309889408 00000100:00100000:0.0:1788587041.836607:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309889408 00000100:00100000:0.0:1788587041.836623:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309889024 00000100:00100000:0.0:1788587041.836625:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309889024 00000100:00100000:0.0:1788587041.836635:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309889536 00000100:00100000:0.0:1788587041.836638:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309889536 00000100:00100000:0.0:1788587041.836648:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587041.836653:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309888896:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836681:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309888896:12345-0@lo:400: Request processed in 28us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836687:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587041.836697:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587041.836701:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309889408:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836735:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309889408:12345-0@lo:400: Request processed in 33us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836741:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587041.836753:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587041.836759:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309889024:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836783:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309889024:12345-0@lo:400: Request processed in 25us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836789:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587041.836821:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587041.836828:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309889536:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836854:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309889536:12345-0@lo:400: Request processed in 28us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836860:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587041.836881:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309888000 00000100:00100000:0.0:1788587041.836884:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309888000 00000100:00100000:0.0:1788587041.836907:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788587041.836912:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309888000:12345-0@lo:400: 00000100:00100000:0.0:1788587041.836938:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309888000:12345-0@lo:400: Request processed in 26us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.836943:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788587041.837215:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309888512 00000100:00100000:0.0:1788587041.837219:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309888512 00000100:00100000:0.0:1788587041.837238:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309888256 00000100:00100000:0.0:1788587041.837241:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309888256 00000100:00100000:0.0:1788587041.837252:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587041.837258:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309888512:12345-0@lo:400: 00000100:00100000:0.0:1788587041.837292:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309888512:12345-0@lo:400: Request processed in 34us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.837314:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587041.837327:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587041.837333:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309888256:12345-0@lo:400: 00000100:00100000:0.0:1788587041.837361:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309888256:12345-0@lo:400: Request processed in 29us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587041.837367:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788587041.837501:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587041.837506:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587041.837509:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587041.837511:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587041.837545:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309888000:0@lo:400: 00000100:00100000:1.0:1788587041.837559:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309888512:0@lo:400: 00010000:00080000:1.0:1788587041.837573:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc3800 x1875469309889024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587041.837583:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309889024:0@lo:400: 00010000:00080000:1.0:1788587041.837594:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc1f80 x1875469309889536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587041.837602:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309889536:0@lo:400: 00000100:00100000:1.0:1788587041.837613:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309888384:0@lo:400: 00010000:00080000:1.0:1788587041.837623:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc2680 x1875469309888896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587041.837638:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309888896:0@lo:400: 00010000:00080000:1.0:1788587041.837651:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc0000 x1875469309889408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587041.837659:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309889408:0@lo:400: 00000100:00100000:1.0:1788587041.837724:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309888256:0@lo:400: 00010000:00080000:1.0:1788587041.837736:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc0700 x1875469309888768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587041.837744:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309888768:0@lo:400: 00010000:00080000:1.0:1788587041.837754:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc0a80 x1875469309889280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587041.837762:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309889280:0@lo:400: 00000100:00100000:1.0:1788587041.837773:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309888128:0@lo:400: 00000100:00100000:1.0:1788587041.837782:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309888640:0@lo:400: 00000100:00100000:1.0:1788587041.837791:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309889152:0@lo:400: 00010000:00010000:2.0:1788587042.226380:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587042.346936:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309889664:0@lo:13: 00000100:00100000:1.0:1788587042.347004:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587042.347073:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309889664 00000100:00100000:1.0:1788587042.347095:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309889664 00000100:00100000:1.0:1788587042.347140:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587042.347149:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309889664:12345-0@lo:13: 00002000:00000024:1.0:1788587042.347181:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587042.347216:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309889792:0@lo:13: 00000100:00100000:1.0:1788587042.347230:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309889664:12345-0@lo:13: Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587042.347236:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788587042.347249:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587042.347259:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309889792 00000100:00100000:1.0:1788587042.347263:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309889792 00000100:00100000:1.0:1788587042.347283:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587042.347289:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309889792:12345-0@lo:13: 00002000:00000024:1.0:1788587042.347428:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587042.347457:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309889792:12345-0@lo:13: Request processed in 168us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587042.347464:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788587042.349391:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a52d80 x1875469309889792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587042.349419:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309889792:0@lo:13: 00010000:00080000:3.0:1788587042.349490:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd50700 x1875469309889664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587042.349504:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309889664:0@lo:13: 00010000:00010000:3.0:1788587043.251831:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587043.372228:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587043.372253:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309889920:0@lo:13: 00000100:00100000:3.0:1788587043.372324:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587043.372412:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309890048:0@lo:13: 00000100:00100000:3.0:1788587043.372438:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587043.372477:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309889920 00000100:00100000:3.0:1788587043.372484:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309889920 00000100:00100000:3.0:1788587043.372733:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309890048 00000100:00100000:3.0:1788587043.372737:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309890048 00000100:00100000:3.0:1788587043.372758:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587043.372776:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309889920:12345-0@lo:13: 00002000:00000024:3.0:1788587043.372833:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587043.372877:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309889920:12345-0@lo:13: Request processed in 112us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587043.372885:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587043.372902:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788587043.372908:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309890048:12345-0@lo:13: 00002000:00000024:3.0:1788587043.372918:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788587043.373014:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587043.375867:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587043.375895:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309890176:0@lo:41: 00000100:00100000:2.0:1788587043.375996:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587043.377340:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309890176 00000100:00100000:0.0:1788587043.377352:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309890176 00000100:00100000:0.0:1788587043.377416:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788587043.377428:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309890048:12345-0@lo:13: Request processed in 4518us (4986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.377430:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309890176:12345-0@lo:41: 00000100:00100000:3.0:1788587043.377445:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00000024:0.0:1788587043.377478:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00080000:3.0:1788587043.377512:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a50700 x1875469309890048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587043.377539:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309890048:0@lo:13: 00000100:00100000:0.0:1788587043.377546:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309890176:12345-0@lo:41: Request processed in 118us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.377554:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788587043.377559:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372ca80 x1875469309889920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587043.377574:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309889920:0@lo:13: 00000100:00100000:0.0:1788587043.377595:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309890176:0@lo:41: 00000020:00000080:3.0:1788587043.425025:0:9885:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe200d5de0 20000000:00000080:3.0:1788587043.425042:0:9885:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbf35f74000 uarg=0000000000000000 20000000:01000000:3.0:1788587043.425087:0:9885:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788587043.425090:0:9885:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788587043.425092:0:9885:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788587043.425096:0:9885:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788587043.425101:0:9885:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788587043.425114:0:9885:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788587043.425116:0:9885:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788587043.425319:0:9885:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788587043.425322:0:9885:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788587043.427362:0:9886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788587043.427884:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788587043.427957:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788587043.428026:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1788587043.428047:0:9885:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788587043.428049:0:9885:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788587043.429196:0:9887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788587043.432633:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788587043.432726:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788587043.432768:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1788587043.432783:0:9885:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788587043.432786:0:9885:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788587043.433663:0:9888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788587043.434197:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788587043.434272:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788587043.434311:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788587043.434333:0:9885:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788587043.434336:0:9885:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788587043.435544:0:9889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788587043.435950:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788587043.435989:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788587043.436030:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788587043.436042:0:9885:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788587043.436044:0:9885:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788587043.437414:0:9890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788587043.437968:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788587043.438011:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788587043.438051:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:0.0:1788587043.438066:0:9885:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788587043.438098:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438117:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438125:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438131:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438138:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634375f expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438149:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634376d expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438156:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438163:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438178:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438185:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438194:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438201:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438209:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438258:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438273:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 9 pid: 6465 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.438287:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890304:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587043.438384:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438393:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 9 pid: 6467 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.438401:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890432:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587043.438440:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438448:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 23 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.438457:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd56680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890560:0@lo:104: 00000100:00100000:0.0:1788587043.438495:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587043.438775:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.438784:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 23 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.438815:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890688:0@lo:104: 00000100:00100000:0.0:1788587043.438834:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587043.443941:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.443959:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 23 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.443974:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890816:0@lo:104: 00000100:00100000:1.0:1788587043.444031:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587043.444723:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309890560 00000100:00100000:2.0:1788587043.444734:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309890560 00000100:00100000:3.0:1788587043.444765:0:9059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309890688 00000100:00100000:3.0:1788587043.444772:0:9059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309890688 00000100:00100000:2.0:1788587043.444812:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587043.444824:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:9885:x1875469309890560:12345-0@lo:104: 00000100:00100000:3.0:1788587043.444844:0:9059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587043.444853:0:9059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+4:9885:x1875469309890688:12345-0@lo:104: 00010000:00010000:3.0:1788587043.444875:0:9059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.444897:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587043.444942:0:9059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587043.444950:0:9059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+4:9885:x1875469309890688:12345-0@lo:104: Request processed in 97us (6113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587043.444958:0:9059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788587043.444959:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587043.444966:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:9885:x1875469309890560:12345-0@lo:104: Request processed in 145us (6470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587043.444972:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788587043.445000:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587043.445006:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445013:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587043.445017:0:8116:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445025:0:8116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587043.445044:0:8116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587043.445050:0:8116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587043.445102:0:8116:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445108:0:8116:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587043.445125:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445132:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf00031000/0x419e1ae1f63437c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63437cf expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445146:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587043.445150:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445155:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587043.445158:0:8116:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445164:0:8116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587043.445171:0:8116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587043.445176:0:8116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587043.445198:0:8116:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445203:0:8116:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587043.445214:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445220:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f63437f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343800 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445230:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587043.445241:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587043.445243:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587043.445250:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587043.445257:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587043.445270:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309890944:0@lo:103: 00000100:00100000:2.0:1788587043.445303:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587043.445341:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309890944 00000100:00100000:2.0:1788587043.445345:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309890944 00010000:00010000:2.0:1788587043.445364:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 24 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587043.445387:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587043.445393:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309890944:12345-0@lo:103: 00010000:00010000:2.0:1788587043.445403:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587043.445408:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 24 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445417:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 24 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587043.445445:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587043.445473:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309890944:12345-0@lo:103: Request processed in 80us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587043.445481:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587043.445539:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309890944:0@lo:103: 00000100:00100000:3.0:1788587043.445617:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309891072:0@lo:103: 00000100:00100000:3.0:1788587043.446264:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587043.448013:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587043.448114:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587043.448148:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309891072 00000100:00100000:0.0:1788587043.448156:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309891072 00010000:00010000:0.0:1788587043.448196:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 24 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.448220:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292016256 00000100:00100000:0.0:1788587043.448223:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292016256 00010000:00010000:0.0:1788587043.448248:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 10 pid: 6465 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.448259:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292016384 00000100:00100000:0.0:1788587043.448261:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292016384 00010000:00010000:0.0:1788587043.448288:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 11 pid: 6467 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.448305:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587043.448314:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309891072:12345-0@lo:103: 00010000:00010000:0.0:1788587043.448330:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.448335:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 24 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.448346:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 24 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.448365:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.448414:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309891072:12345-0@lo:103: Request processed in 101us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.448421:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587043.448439:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:0.0:1788587043.448445:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:2409:x1875469292016256:12345-192.168.203.14@tcp:103: 00010000:00010000:0.0:1788587043.448454:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.448459:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 11 pid: 6465 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.448469:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 11 pid: 6465 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.448479:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.448514:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:2409:x1875469292016256:12345-192.168.203.14@tcp:103: Request processed in 69us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.448522:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:0.0:1788587043.448541:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:0.0:1788587043.448548:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2409:x1875469292016384:12345-192.168.203.14@tcp:103: 00010000:00010000:0.0:1788587043.448557:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.448562:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 10 pid: 6467 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.448572:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 10 pid: 6467 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.448581:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.448600:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2409:x1875469292016384:12345-192.168.203.14@tcp:103: Request processed in 52us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.448606:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:0.0:1788587043.448724:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309891072:0@lo:103: 00010000:00010000:1.0:1788587043.451486:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.451506:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 23 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.451520:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891200:0@lo:104: 00000100:00100000:1.0:1788587043.451576:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587043.451708:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634376d expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.451742:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634376d expref: 23 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.451751:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891328:0@lo:104: 00010000:00010000:1.0:1788587043.451784:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634375f expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.451791:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634375f expref: 23 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.451828:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891456:0@lo:104: 00010000:00010000:1.0:1788587043.451854:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.451862:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 23 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.451869:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891584:0@lo:104: 00010000:00010000:1.0:1788587043.451893:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.451900:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 23 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.451907:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891712:0@lo:104: 00010000:00010000:1.0:1788587043.451927:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.451943:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 23 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.451952:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891840:0@lo:104: 00000100:00100000:1.0:1788587043.451973:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b300 going to sleep for 11 seconds 00010000:00010000:1.0:1788587043.452031:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56a1 expref: 9 pid: 6465 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.452046:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890304:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587043.452060:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f634380e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd569a expref: 8 pid: 6467 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.452070:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890432:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587043.452215:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63437f9 expref: 23 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.452226:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd56680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890560:0@lo:104: 00010000:00010000:1.0:1788587043.452252:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf00030200/0x419e1ae1f63437cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63437c8 expref: 22 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587043.452266:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890688:0@lo:104: 00000100:00100000:2.0:1788587043.452517:0:6456:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788587043.452538:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587043.452612:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587043.452658:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587043.452673:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309890816 00000100:00100000:0.0:1788587043.452680:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309890816 00000100:00100000:0.0:1788587043.452727:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309891200 00000100:00100000:0.0:1788587043.452730:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309891200 00000100:00100000:0.0:1788587043.452740:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309891328 00000100:00100000:0.0:1788587043.452742:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309891328 00000100:00100000:0.0:1788587043.452748:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309891456 00000100:00100000:0.0:1788587043.452750:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309891456 00000100:00100000:0.0:1788587043.452761:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587043.452771:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+6:9885:x1875469309890816:12345-0@lo:104: 00010000:00010000:0.0:1788587043.452785:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.452869:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587043.452875:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+6:9885:x1875469309890816:12345-0@lo:104: Request processed in 106us (8844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.452890:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587043.452907:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587043.452913:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+5:9885:x1875469309891200:12345-0@lo:104: 00010000:00010000:0.0:1788587043.452922:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.452957:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788587043.452962:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+5:9885:x1875469309891200:12345-0@lo:104: Request processed in 50us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.452967:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587043.452997:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587043.453003:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:9885:x1875469309891328:12345-0@lo:104: 00010000:00010000:0.0:1788587043.453010:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453040:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788587043.453045:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:9885:x1875469309891328:12345-0@lo:104: Request processed in 43us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.453050:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587043.453060:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587043.453066:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:9885:x1875469309891456:12345-0@lo:104: 00010000:00010000:0.0:1788587043.453086:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453117:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788587043.453121:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:9885:x1875469309891456:12345-0@lo:104: Request processed in 57us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.453133:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788587043.453151:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788587043.453156:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453164:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587043.453168:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453176:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587043.453183:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587043.453189:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587043.453218:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453225:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788587043.453393:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309890816:0@lo:104: 00000100:00100000:1.0:1788587043.453403:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891200:0@lo:104: 00000100:00100000:1.0:1788587043.453411:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891328:0@lo:104: 00000100:00100000:1.0:1788587043.453418:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891456:0@lo:104: 00000100:00100000:1.0:1788587043.453600:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309891968:0@lo:103: 00000100:00100000:1.0:1788587043.453635:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587043.453684:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453692:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483400/0x419e1ae1f63437ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63437b3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453754:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788587043.453757:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453772:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587043.453774:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453789:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587043.453818:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587043.453827:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587043.453848:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453854:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587043.453867:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453873:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01483200/0x419e1ae1f6343789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343790 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453882:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587043.453885:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453890:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587043.453892:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453908:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587043.453913:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587043.453917:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587043.453930:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.453935:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587043.453940:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.454007:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01482a00/0x419e1ae1f634376d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343774 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.454017:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587043.454020:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.454025:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587043.454028:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.454034:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587043.454041:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587043.454052:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587043.454067:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.454082:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587043.454098:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.454105:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01482200/0x419e1ae1f634375f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343766 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.454115:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587043.454117:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587043.454118:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587043.454126:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587043.454136:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309892224:0@lo:103: 00000100:00100000:0.0:1788587043.454164:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587043.454191:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587043.454196:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309892096:0@lo:103: 00000100:00100000:0.0:1788587043.454334:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587043.454362:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309891968 00000100:00100000:0.0:1788587043.454367:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309891968 00000100:00100000:1.0:1788587043.454412:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587043.454420:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309892352:0@lo:103: 00000100:00100000:1.0:1788587043.454446:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587043.454485:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 22 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.454504:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309892224 00000100:00100000:0.0:1788587043.454507:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309892224 00010000:00010000:0.0:1788587043.454518:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634376d expref: 23 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.454540:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309892096 00000100:00100000:0.0:1788587043.454543:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309892096 00010000:00010000:0.0:1788587043.454553:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 24 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.454568:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309892352 00000100:00100000:0.0:1788587043.454570:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309892352 00000100:00100000:2.0:1788587043.454653:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587043.454665:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587043.454673:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309891584 00000100:00100000:2.0:1788587043.454676:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309891584 00000100:00100000:1.0:1788587043.454828:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309891712 00000100:00100000:1.0:1788587043.454832:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309891712 00000100:00100000:1.0:1788587043.454855:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309891840 00000100:00100000:1.0:1788587043.454858:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309891840 00000100:00100000:3.0:1788587043.454870:0:9059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587043.454884:0:9059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+5:9885:x1875469309891584:12345-0@lo:104: 00010000:00010000:3.0:1788587043.454896:0:9059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.454910:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634375f expref: 25 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587043.454950:0:9059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587043.454958:0:9059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+5:9885:x1875469309891584:12345-0@lo:104: Request processed in 78us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587043.454963:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587043.454971:0:9059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587043.454976:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+5:9885:x1875469309891712:12345-0@lo:104: 00010000:00010000:1.0:1788587043.454986:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587043.454994:0:9059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587043.455003:0:9059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+4:9885:x1875469309891840:12345-0@lo:104: 00010000:00010000:3.0:1788587043.455012:0:9059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.455029:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788587043.455036:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:9885:x1875469309891712:12345-0@lo:104: Request processed in 65us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587043.455044:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788587043.455049:0:9059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788587043.455057:0:9059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+3:9885:x1875469309891840:12345-0@lo:104: Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587043.455066:0:9059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788587043.455097:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891584:0@lo:104: 00000100:00100000:1.0:1788587043.455107:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891712:0@lo:104: 00000100:00100000:1.0:1788587043.455115:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9885:1875469309891840:0@lo:104: 00010000:00010000:1.0:1788587043.455157:0:9885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.455202:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587043.455210:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+25:3473:x1875469309891968:12345-0@lo:103: 00010000:00010000:0.0:1788587043.455222:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.455228:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 25 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455308:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 25 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455323:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01482c00/0x419e1ae1f63437b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63437ac expref: 25 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455337:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.455412:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309891968:12345-0@lo:103: Request processed in 203us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.455419:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587043.455432:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587043.455438:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+23:3475:x1875469309892224:12345-0@lo:103: 00010000:00010000:0.0:1788587043.455455:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.455460:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634376d expref: 23 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455468:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634376d expref: 23 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455478:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6343774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634376d expref: 23 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455486:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.455526:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+22:3475:x1875469309892224:12345-0@lo:103: Request processed in 88us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.455533:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587043.455545:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587043.455551:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+21:3475:x1875469309892096:12345-0@lo:103: 00010000:00010000:0.0:1788587043.455559:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.455563:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 21 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455571:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 21 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455581:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483200/0x419e1ae1f6343790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343789 expref: 21 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455589:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.455609:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+20:3475:x1875469309892096:12345-0@lo:103: Request processed in 59us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.455625:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587043.455638:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587043.455643:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+19:3473:x1875469309892352:12345-0@lo:103: 00010000:00010000:0.0:1788587043.455652:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.455656:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634375f expref: 19 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455664:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634375f expref: 19 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455673:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6343766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634375f expref: 19 pid: 6464 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455681:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.455714:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+18:3473:x1875469309892352:12345-0@lo:103: Request processed in 71us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.455719:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788587043.455761:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788587043.455768:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455775:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587043.455778:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455787:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587043.455811:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587043.455824:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587043.455849:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455854:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587043.455862:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455868:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f6343751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343758 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455877:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587043.455880:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455885:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587043.455888:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455893:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587043.455899:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587043.455904:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587043.455916:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455921:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587043.455933:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455939:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01482e00/0x419e1ae1f6343712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343719 expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455949:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587043.455952:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455957:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483600 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587043.455960:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455966:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587043.455971:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587043.455976:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587043.455987:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.455993:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587043.455997:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456004:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483600/0x419e1ae1f63436e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63436ef expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456014:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587043.456022:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587043.456023:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587043.456030:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587043.456046:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587043.456058:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309892480:0@lo:103: 00000100:00100000:0.0:1788587043.456098:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587043.456180:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309892736:0@lo:103: 00000100:00100000:3.0:1788587043.456205:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587043.456397:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309892608:0@lo:103: 00000100:00100000:2.0:1788587043.456424:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587043.456484:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309891968:0@lo:103: 00000100:00100000:1.0:1788587043.456499:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309892352:0@lo:103: 00000100:00100000:0.0:1788587043.456558:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309892480 00000100:00100000:0.0:1788587043.456564:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309892480 00010000:00010000:0.0:1788587043.456585:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 18 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.456601:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309892736 00000100:00100000:0.0:1788587043.456603:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309892736 00010000:00010000:0.0:1788587043.456613:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 19 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.456622:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309892608 00000100:00100000:0.0:1788587043.456624:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309892608 00010000:00010000:0.0:1788587043.456633:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 20 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587043.456646:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587043.456651:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+20:3472:x1875469309892480:12345-0@lo:103: 00010000:00010000:0.0:1788587043.456659:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.456663:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 20 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456673:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 20 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456683:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482800/0x419e1ae1f6343758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343751 expref: 20 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456708:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.456776:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+19:3472:x1875469309892480:12345-0@lo:103: Request processed in 124us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.456784:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587043.456812:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587043.456818:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+18:3475:x1875469309892736:12345-0@lo:103: 00010000:00010000:0.0:1788587043.456825:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.456829:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 18 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456836:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 18 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456845:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01483600/0x419e1ae1f63436ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63436e8 expref: 18 pid: 6467 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456853:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.456873:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+17:3475:x1875469309892736:12345-0@lo:103: Request processed in 56us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.456879:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587043.456890:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587043.456895:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+16:3474:x1875469309892608:12345-0@lo:103: 00010000:00010000:0.0:1788587043.456902:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587043.456906:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 16 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456914:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 16 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456931:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343712 expref: 16 pid: 6465 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456941:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456949:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456963:0:6459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456970:0:6459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456977:0:6459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456983:0:6459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.456989:0:6459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587043.456993:0:6459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.457001:0:6459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587043.457015:0:6459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587043.459022:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309892736:0@lo:103: 00000100:00100000:3.0:1788587043.459043:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309892096:0@lo:103: 00000100:00100000:3.0:1788587043.459053:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309892224:0@lo:103: 00010000:00010000:3.0:1788587043.459879:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587043.460087:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587043.460177:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+15:3474:x1875469309892608:12345-0@lo:103: Request processed in 3279us (3749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.460188:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587043.460879:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309892608:0@lo:103: 00000100:00100000:1.0:1788587043.461135:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309892480:0@lo:103: 00010000:00010000:1.0:1788587043.461167:0:9885:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.461180:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587043.461188:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343854 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587043.462401:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587043.883035:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587043.883060:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309892864:0@lo:41: 00000100:00100000:3.0:1788587043.883144:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587043.883427:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309892864 00000100:00100000:0.0:1788587043.883435:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309892864 00000100:00100000:0.0:1788587043.883486:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788587043.883496:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309892864:12345-0@lo:41: 00000004:00000024:0.0:1788587043.883532:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587043.883578:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309892864:12345-0@lo:41: Request processed in 83us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587043.883584:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788587043.884142:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309892864:0@lo:41: 00010000:00010000:0.0:1788587044.268120:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587045.291248:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788587045.354924:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788587045.354933:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe040c5800 from 48 10000000:01000000:3.0:1788587045.354938:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587045.354990:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.355003:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.355015:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587045.355041:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309892992:0@lo:101: 00000100:00100000:3.0:1788587045.355122:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.355229:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.359597:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309892992 00000100:00100000:1.0:1788587045.359613:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309892992 00000100:00100000:1.0:1788587045.359681:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788587045.359692:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+15:6469:x1875469309892992:12345-0@lo:101: 00010000:00010000:1.0:1788587045.359771:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587045.359809:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634385b expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.359839:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634385b expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.359850:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634385b expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.359859:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc000, rc 0) 00000100:00100000:1.0:1788587045.360005:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309892992:12345-0@lo:101: Request processed in 315us (4882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.360012:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788587045.368035:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309892992:0@lo:101: 00010000:00010000:3.0:1788587045.368095:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.368109:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587045.368462:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893120:0@lo:501: 00000100:00100000:3.0:1788587045.368588:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.368712:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.371621:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309893120 00000100:00100000:1.0:1788587045.371657:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309893120 00000100:00100000:1.0:1788587045.372490:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788587045.372506:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309893120:12345-0@lo:501: 00000100:00100000:1.0:1788587045.373873:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309893120:12345-0@lo:501: Request processed in 1366us (5278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.373884:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788587045.373988:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893120:0@lo:501: 00000100:00100000:3.0:1788587045.374041:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893248:0@lo:503: 00000100:00100000:3.0:1788587045.374734:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587045.381931:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309893248 00000100:00100000:0.0:1788587045.381947:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309893248 00000100:00100000:2.0:1788587045.382025:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788587045.382039:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309893248:12345-0@lo:503: 00000100:00100000:2.0:1788587045.382358:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309893248:12345-0@lo:503: Request processed in 320us (7624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587045.382366:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788587045.382429:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587045.382456:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893248:0@lo:503: 00000100:00100000:2.0:1788587045.384296:0:9902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9902:1875469309893376:0@lo:502: 00000100:00100000:2.0:1788587045.384380:0:9902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.384541:0:9902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.384641:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309893376 00000100:00100000:1.0:1788587045.384649:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309893376 00000100:00100000:1.0:1788587045.384739:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788587045.384750:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9902:x1875469309893376:12345-0@lo:502: 00000100:00100000:1.0:1788587045.386092:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+16:9902:x1875469309893376:12345-0@lo:502: Request processed in 1338us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.386103:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788587045.386196:0:9902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9902:1875469309893376:0@lo:502: 00000100:00100000:2.0:1788587045.386253:0:9902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9902:1875469309893504:0@lo:502: 00000100:00100000:2.0:1788587045.386297:0:9902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.386376:0:9902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.386414:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309893504 00000100:00100000:1.0:1788587045.386420:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309893504 00000100:00100000:1.0:1788587045.386500:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788587045.386509:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:9902:x1875469309893504:12345-0@lo:502: 00000100:00100000:1.0:1788587045.386689:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+16:9902:x1875469309893504:12345-0@lo:502: Request processed in 180us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.386696:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788587045.386761:0:9902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9902:1875469309893504:0@lo:502: 00000040:00080000:2.0:1788587045.386781:0:9902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788587045.387109:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788587045.387131:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587045.387141:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.387151:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587045.387161:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788587045.387164:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788587045.387166:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788587045.387191:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.387199:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.387221:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587045.387235:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893632:0@lo:101: 00000100:00100000:3.0:1788587045.387280:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.387744:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.387905:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309893632 00000100:00100000:0.0:1788587045.387912:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309893632 00000100:00100000:0.0:1788587045.387944:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788587045.387954:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+16:6469:x1875469309893632:12345-0@lo:101: 00010000:00010000:0.0:1788587045.387964:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587045.387979:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343869 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.388286:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343869 expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.388297:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343869 expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.388315:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482600, rc 0) 00000100:00100000:0.0:1788587045.388408:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309893632:12345-0@lo:101: Request processed in 455us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.388415:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788587045.392213:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893632:0@lo:101: 00010000:00010000:3.0:1788587045.392244:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.392258:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587045.392494:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893760:0@lo:501: 00000100:00100000:2.0:1788587045.392550:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.392594:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.392704:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309893760 00000100:00100000:3.0:1788587045.392711:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309893760 00000100:00100000:3.0:1788587045.392758:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788587045.392767:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309893760:12345-0@lo:501: 00000100:00100000:3.0:1788587045.393016:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309893760:12345-0@lo:501: Request processed in 249us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.393022:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788587045.393226:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893760:0@lo:501: 00000100:00100000:2.0:1788587045.393257:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893888:0@lo:503: 00000100:00100000:2.0:1788587045.393298:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.393318:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.393824:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309893888 00000100:00100000:3.0:1788587045.393834:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309893888 00000100:00100000:3.0:1788587045.393873:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788587045.393883:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309893888:12345-0@lo:503: 00000100:00100000:3.0:1788587045.394044:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309893888:12345-0@lo:503: Request processed in 162us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.394059:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788587045.394243:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309893888:0@lo:503: 00000100:00100000:0.0:1788587045.394839:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9903:1875469309894016:0@lo:502: 00000100:00100000:0.0:1788587045.394883:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587045.394909:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.395292:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309894016 00000100:00100000:3.0:1788587045.395298:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309894016 00000100:00100000:3.0:1788587045.395337:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788587045.395345:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9903:x1875469309894016:12345-0@lo:502: 00000100:00100000:3.0:1788587045.395533:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+17:9903:x1875469309894016:12345-0@lo:502: Request processed in 187us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.395540:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788587045.395623:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9903:1875469309894016:0@lo:502: 00000020:01000000:1.0:1788587045.395650:0:9903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587045.395659:0:9903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587045.395661:0:9903:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788587045.395666:0:9903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788587045.395691:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9903:1875469309894144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.395743:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.395783:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf271826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.396028:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309894144 00000100:00100000:0.0:1788587045.396033:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309894144 00000100:00100000:0.0:1788587045.396076:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788587045.396083:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:9903:x1875469309894144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587045.396225:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+17:9903:x1875469309894144:12345-0@lo:502:llog_process_th.0 Request processed in 142us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.396233:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788587045.396287:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9903:1875469309894144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587045.396383:0:9903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587045.396388:0:9903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587045.396390:0:9903:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788587045.396394:0:9903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788587045.398490:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788587045.398584:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788587045.398596:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.398608:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587045.398618:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788587045.398625:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf3d10b000 from 48 10000000:01000000:3.0:1788587045.398628:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587045.398667:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.398675:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.398684:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587045.398708:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309894272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.398785:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.399101:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.399141:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309894272 00000100:00100000:0.0:1788587045.399149:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309894272 00000100:00100000:0.0:1788587045.399234:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788587045.399244:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+17:6469:x1875469309894272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587045.399256:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587045.399268:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634387e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343877 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.399293:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634387e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343877 expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.399304:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634387e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343877 expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.399320:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482800, rc 0) 00000100:00100000:0.0:1788587045.399367:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309894272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.399374:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788587045.399448:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309894272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587045.399463:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587045.399473:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587045.399536:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309894400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.399563:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.402875:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf052329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.403200:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309894400 00000100:00100000:3.0:1788587045.403209:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309894400 00000100:00100000:3.0:1788587045.403253:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788587045.403262:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309894400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.403607:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309894400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (4041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.403616:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788587045.403826:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309894400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.403880:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309894528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.403926:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.403946:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf052329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.404069:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309894528 00000100:00100000:0.0:1788587045.404074:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309894528 00000100:00100000:0.0:1788587045.404102:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788587045.404110:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309894528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587045.404272:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309894528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.404279:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788587045.404780:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309894528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.409641:0:9904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9904:1875469309894656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587045.409739:0:9904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.409871:0:9904:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.409985:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309894656 00000100:00100000:0.0:1788587045.410069:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309894656 00000100:00100000:0.0:1788587045.410157:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788587045.410167:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:9904:x1875469309894656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587045.410535:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+18:9904:x1875469309894656:12345-0@lo:502:llog_process_th.0 Request processed in 368us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.410543:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788587045.410632:0:9904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9904:1875469309894656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587045.410680:0:9904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9904:1875469309894784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587045.410717:0:9904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.410774:0:9904:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.410835:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309894784 00000100:00100000:0.0:1788587045.410839:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309894784 00000100:00100000:3.0:1788587045.410929:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788587045.410940:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:9904:x1875469309894784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587045.411254:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:9904:x1875469309894784:12345-0@lo:502:llog_process_th.0 Request processed in 317us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.411261:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788587045.411643:0:9904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9904:1875469309894784:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788587045.411667:0:9904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788587045.412085:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788587045.412102:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587045.412113:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.412125:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587045.412136:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788587045.412138:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788587045.412141:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788587045.412172:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.412180:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.412199:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587045.412217:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309894912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.412256:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.412333:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.412369:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309894912 00000100:00100000:0.0:1788587045.412375:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309894912 00000100:00100000:0.0:1788587045.412513:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788587045.412523:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+18:6469:x1875469309894912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587045.412533:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587045.412551:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483600/0x419e1ae1f634388c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343885 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.412572:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483600/0x419e1ae1f634388c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343885 expref: 19 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.412583:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483600/0x419e1ae1f634388c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343885 expref: 19 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.412591:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483600, rc 0) 00000100:00100000:0.0:1788587045.412634:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309894912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.412640:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788587045.412700:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309894912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587045.412714:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587045.412722:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587045.412771:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.412837:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.413823:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.413913:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309895040 00000100:00100000:3.0:1788587045.413919:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309895040 00000100:00100000:3.0:1788587045.413957:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788587045.413965:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309895040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.414280:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309895040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.414288:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788587045.414370:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.414412:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.414464:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.414490:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.414589:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309895168 00000100:00100000:3.0:1788587045.414593:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309895168 00000100:00100000:3.0:1788587045.414612:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788587045.414617:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309895168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.414759:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309895168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.414766:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788587045.414879:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.415315:0:9905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9905:1875469309895296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587045.415353:0:9905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.415382:0:9905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.415501:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309895296 00000100:00100000:3.0:1788587045.415506:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309895296 00000100:00100000:3.0:1788587045.415536:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788587045.415544:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:9905:x1875469309895296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587045.418652:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:9905:x1875469309895296:12345-0@lo:502:llog_process_th.0 Request processed in 3099us (3289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.418681:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788587045.420692:0:9905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9905:1875469309895296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587045.420830:0:9905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587045.420842:0:9905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587045.420844:0:9905:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788587045.420851:0:9905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788587045.420890:0:9905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9905:1875469309895424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587045.420960:0:9905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.420990:0:9905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.421259:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309895424 00000100:00100000:0.0:1788587045.421266:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309895424 00000100:00100000:0.0:1788587045.421362:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788587045.421388:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:9905:x1875469309895424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587045.421754:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+19:9905:x1875469309895424:12345-0@lo:502:llog_process_th.0 Request processed in 383us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.421762:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788587045.422143:0:9905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9905:1875469309895424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587045.423643:0:9905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587045.423656:0:9905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587045.423659:0:9905:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788587045.423665:0:9905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788587045.425837:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788587045.428556:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788587045.428575:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.428591:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587045.428604:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788587045.428607:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf04818800 from 48 10000000:01000000:1.0:1788587045.428610:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587045.428661:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.428670:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.428681:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587045.428707:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.428782:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.428848:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.429269:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309895552 00000100:00100000:3.0:1788587045.429278:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309895552 00000100:00100000:3.0:1788587045.429374:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788587045.429385:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+19:6469:x1875469309895552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587045.429408:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587045.429422:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37104400/0x419e1ae1f634389a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343893 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.430402:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37104400/0x419e1ae1f634389a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343893 expref: 20 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.430561:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37104400/0x419e1ae1f634389a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343893 expref: 20 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.430572:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37104400, rc 0) 00000100:00100000:3.0:1788587045.430694:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309895552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1311us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.430726:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788587045.432837:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587045.432883:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.432897:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587045.432982:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.433053:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587045.433857:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309895680 00000100:00100000:0.0:1788587045.433866:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309895680 00000100:00100000:0.0:1788587045.433916:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788587045.433926:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309895680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.434907:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.435275:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309895680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1347us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.435286:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788587045.435381:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.435664:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.435717:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.435747:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.436021:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309895808 00000100:00100000:3.0:1788587045.436028:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309895808 00000100:00100000:3.0:1788587045.436889:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788587045.436902:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309895808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.437124:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309895808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.437132:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788587045.437216:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309895808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.438355:0:9906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9906:1875469309895936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.438441:0:9906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.439152:0:9906:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.439665:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309895936 00000100:00100000:0.0:1788587045.439688:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309895936 00000100:00100000:2.0:1788587045.440836:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788587045.440855:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:9906:x1875469309895936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587045.441310:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:9906:x1875469309895936:12345-0@lo:502:llog_process_th.0 Request processed in 463us (2868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587045.441327:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788587045.443319:0:9906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9906:1875469309895936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.443418:0:9906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9906:1875469309896064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.443593:0:9906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.443638:0:9906:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587045.443720:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309896064 00000100:00100000:2.0:1788587045.443726:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309896064 00000100:00100000:2.0:1788587045.443776:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788587045.443787:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:9906:x1875469309896064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587045.444177:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:9906:x1875469309896064:12345-0@lo:502:llog_process_th.0 Request processed in 391us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587045.444186:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788587045.444276:0:9906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9906:1875469309896064:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788587045.444302:0:9906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788587045.444576:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788587045.444596:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587045.444606:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587045.444617:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587045.444627:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788587045.444630:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788587045.444633:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788587045.444661:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587045.444669:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587045.444678:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587045.444693:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587045.444735:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.444766:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.445233:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309896192 00000100:00100000:3.0:1788587045.445248:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309896192 00000100:00100000:3.0:1788587045.445290:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788587045.445299:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309896192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587045.445312:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587045.445325:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37105800/0x419e1ae1f63438a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63438a1 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.445348:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37105800/0x419e1ae1f63438a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63438a1 expref: 21 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.445359:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37105800/0x419e1ae1f63438a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63438a1 expref: 21 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.445368:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105800, rc 0) 00000100:00100000:3.0:1788587045.445653:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309896192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.445660:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788587045.445761:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587045.445783:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.445826:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587045.445891:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.445923:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.445947:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.446048:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309896320 00000100:00100000:3.0:1788587045.446053:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309896320 00000100:00100000:3.0:1788587045.446238:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788587045.446246:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309896320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.446949:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309896320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 702us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.446958:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788587045.447536:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.447576:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.447621:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.449567:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.449663:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309896448 00000100:00100000:0.0:1788587045.449672:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309896448 00000100:00100000:0.0:1788587045.449715:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788587045.449724:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309896448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587045.449972:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309896448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.449980:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788587045.450125:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.451324:0:9907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9907:1875469309896576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587045.451388:0:9907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.451447:0:9907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3d0f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.451607:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309896576 00000100:00100000:1.0:1788587045.451613:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309896576 00000100:00100000:1.0:1788587045.451654:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788587045.451663:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:9907:x1875469309896576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.451938:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:9907:x1875469309896576:12345-0@lo:502:llog_process_th.0 Request processed in 275us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.451947:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788587045.452057:0:9907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9907:1875469309896576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587045.452112:0:9907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587045.452122:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587045.452124:0:9907:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788587045.452130:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788587045.452152:0:9907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9907:1875469309896704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587045.452187:0:9907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587045.452229:0:9907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf052329c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.452847:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309896704 00000100:00100000:1.0:1788587045.452856:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309896704 00000100:00100000:1.0:1788587045.452897:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788587045.452906:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:9907:x1875469309896704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.453154:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:9907:x1875469309896704:12345-0@lo:502:llog_process_th.0 Request processed in 249us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.453170:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788587045.453602:0:9907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9907:1875469309896704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587045.453635:0:9907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587045.453642:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587045.453644:0:9907:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788587045.453649:0:9907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788587045.453914:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788587045.453934:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788587045.453943:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.453954:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587045.453963:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788587045.453966:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf11802800 from 48 10000000:01000000:1.0:1788587045.453968:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587045.454155:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.454165:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.454174:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587045.454193:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.454234:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.454274:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587045.454318:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309896832 00000100:00100000:2.0:1788587045.454323:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309896832 00000100:00100000:2.0:1788587045.454392:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788587045.454409:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309896832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587045.454420:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587045.454441:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044400/0x419e1ae1f63438b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63438af expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587045.454467:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044400/0x419e1ae1f63438b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63438af expref: 22 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587045.454478:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044400/0x419e1ae1f63438b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63438af expref: 22 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587045.454501:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044400, rc 0) 00000100:00100000:2.0:1788587045.454543:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309896832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587045.454549:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788587045.454612:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587045.454626:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.454635:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587045.454682:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.454708:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.457357:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3d0f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.458715:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309896960 00000100:00100000:1.0:1788587045.458729:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309896960 00000100:00100000:1.0:1788587045.458791:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788587045.458814:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309896960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.459309:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309896960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 495us (4597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.459324:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788587045.461943:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309896960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.462089:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309897088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.462173:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.462218:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3d0f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.462282:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309897088 00000100:00100000:1.0:1788587045.462291:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309897088 00000100:00100000:1.0:1788587045.462346:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788587045.462355:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309897088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.462633:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309897088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.462641:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788587045.462682:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309897088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.462899:0:9908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd52d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9908:1875469309897216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.462933:0:9908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.462949:0:9908:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.463627:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309897216 00000100:00100000:3.0:1788587045.463637:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309897216 00000100:00100000:3.0:1788587045.463682:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788587045.463691:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:9908:x1875469309897216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587045.463973:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:9908:x1875469309897216:12345-0@lo:502:llog_process_th.0 Request processed in 283us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.463981:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788587045.464841:0:9908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd52d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9908:1875469309897216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.464905:0:9908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd52d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9908:1875469309897344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587045.464948:0:9908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587045.464974:0:9908:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.465101:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309897344 00000100:00100000:0.0:1788587045.465107:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309897344 00000100:00100000:0.0:1788587045.465146:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788587045.465154:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:9908:x1875469309897344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587045.465313:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:9908:x1875469309897344:12345-0@lo:502:llog_process_th.0 Request processed in 158us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.465320:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788587045.465511:0:9908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd52d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9908:1875469309897344:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788587045.465541:0:9908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788587045.465746:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788587045.465767:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788587045.465776:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.465787:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587045.465824:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788587045.465827:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788587045.465830:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788587045.465855:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.465875:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.465883:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587045.465989:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309897472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587045.466145:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587045.466173:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.466260:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309897472 00000100:00100000:1.0:1788587045.466265:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309897472 00000100:00100000:1.0:1788587045.466290:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788587045.466297:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309897472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587045.466307:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587045.466327:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f63438c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63438bd expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.466347:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f63438c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63438bd expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.466358:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f63438c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63438bd expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587045.466367:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cce00, rc 0) 00000100:00100000:1.0:1788587045.466410:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309897472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.466417:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788587045.466547:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309897472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587045.466561:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.466571:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587045.466639:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309897600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.466665:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.466689:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3d0f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.466733:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309897600 00000100:00100000:1.0:1788587045.466738:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309897600 00000100:00100000:1.0:1788587045.466768:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788587045.466775:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309897600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.467193:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309897600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 416us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.467200:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788587045.467536:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309897600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.467573:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309897728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.467614:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.467674:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3d0f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587045.467710:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309897728 00000100:00100000:1.0:1788587045.467715:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309897728 00000100:00100000:1.0:1788587045.467780:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788587045.467788:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309897728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587045.468105:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309897728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 318us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587045.468113:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788587045.468258:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309897728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587045.468684:0:9909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9909:1875469309897856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587045.468730:0:9909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587045.468764:0:9909:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.468819:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309897856 00000100:00100000:3.0:1788587045.468824:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309897856 00000100:00100000:3.0:1788587045.468861:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788587045.468870:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:9909:x1875469309897856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587045.469085:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:9909:x1875469309897856:12345-0@lo:502:llog_process_th.0 Request processed in 215us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.469093:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788587045.469244:0:9909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9909:1875469309897856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587045.469271:0:9909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587045.469281:0:9909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587045.469283:0:9909:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788587045.469289:0:9909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788587045.469310:0:9909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9909:1875469309897984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587045.469343:0:9909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587045.469373:0:9909:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587045.469425:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309897984 00000100:00100000:3.0:1788587045.469429:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309897984 00000100:00100000:3.0:1788587045.469462:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788587045.469468:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:9909:x1875469309897984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587045.469605:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:9909:x1875469309897984:12345-0@lo:502:llog_process_th.0 Request processed in 136us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587045.469612:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788587045.469688:0:9909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9909:1875469309897984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587045.469704:0:9909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587045.469708:0:9909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587045.469710:0:9909:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788587045.469718:0:9909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788587045.469879:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1788587045.469901:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788587045.469909:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.469925:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587045.469935:0:6469:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788587045.469937:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbf053a99c0 from 1 10000000:01000000:3.0:1788587045.469940:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788587045.469962:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.469970:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587045.469978:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587045.469989:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309898112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587045.470025:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587045.470048:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.470147:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309898112 00000100:00100000:0.0:1788587045.470152:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309898112 00000100:00100000:0.0:1788587045.470182:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788587045.470189:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309898112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587045.470197:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587045.470208:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483200/0x419e1ae1f63438d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63438cb expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.470226:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483200/0x419e1ae1f63438d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63438cb expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.470236:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483200/0x419e1ae1f63438d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63438cb expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.470243:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483200, rc 0) 00000100:00100000:0.0:1788587045.470273:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309898112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587045.470279:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788587045.470304:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309898112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587045.470315:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438d2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.470323:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63438d2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587045.470361:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309898240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587045.470382:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587045.470402:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587045.470413:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309898240 00000100:00100000:0.0:1788587045.470417:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309898240 00000100:00100000:0.0:1788587045.470435:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788587045.470441:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309898240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587045.470612:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309898240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (228us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788587045.470619:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788587045.470643:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309898240:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788587045.470659:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788587045.470664:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438d2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587045.470671:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438d2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587046.035406:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587046.035451:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587046.035498:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587046.035545:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587046.035566:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587046.035840:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292016896 00000100:00100000:1.0:1788587046.035871:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292016896 00000100:00100000:1.0:1788587046.035939:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292017024 00000100:00100000:1.0:1788587046.035942:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292017024 00000100:00100000:1.0:1788587046.035965:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:1.0:1788587046.035978:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292016896:12345-192.168.203.14@tcp:400: 00000100:00100000:0.0:1788587046.036301:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292016640 00000100:00100000:0.0:1788587046.036307:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292016640 00000100:00100000:0.0:1788587046.036343:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292016768 00000100:00100000:0.0:1788587046.036346:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292016768 00000100:00100000:0.0:1788587046.036368:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:0.0:1788587046.036375:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292016640:12345-192.168.203.14@tcp:400: 00000100:00100000:0.0:1788587046.036449:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292016640:12345-192.168.203.14@tcp:400: Request processed in 74us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587046.036456:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:0.0:1788587046.036473:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:0.0:1788587046.036478:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292016768:12345-192.168.203.14@tcp:400: 00000100:00100000:0.0:1788587046.036512:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292016768:12345-192.168.203.14@tcp:400: Request processed in 34us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587046.036518:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:0.0:1788587046.036538:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:0.0:1788587046.036544:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292017024:12345-192.168.203.14@tcp:400: 00000100:00100000:0.0:1788587046.036570:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292017024:12345-192.168.203.14@tcp:400: Request processed in 26us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587046.036575:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00080000:3.0:1788587046.037088:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587046.037103:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587046.037105:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587046.037108:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587046.037336:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292016512 00000100:00100000:2.0:1788587046.037344:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292016512 00000100:00100000:2.0:1788587046.037384:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 239 00000100:00100000:2.0:1788587046.037394:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:2412:x1875469292016512:12345-192.168.203.14@tcp:400: 00000100:00100000:2.0:1788587046.037441:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:2412:x1875469292016512:12345-192.168.203.14@tcp:400: Request processed in 49us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587046.037448:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 239 00000100:00100000:1.0:1788587046.037589:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292016896:12345-192.168.203.14@tcp:400: Request processed in 1613us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587046.037597:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00010000:00010000:3.0:1788587046.316655:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587046.955010:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309898496:0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.955087:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587046.955190:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309898368:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.955216:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309898496 00000100:00100000:1.0:1788587046.955226:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309898496 00000100:00100000:3.0:1788587046.955244:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587046.955280:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587046.955291:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309898496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587046.955309:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309898368 00000100:00100000:3.0:1788587046.955315:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309898368 00000100:00100000:3.0:1788587046.955349:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788587046.955357:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309898368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587046.957226:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309898368:12345-0@lo:400:kworker.0 Request processed in 1860us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587046.957239:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788587046.957305:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309898624:0@lo:400:kworker.0 00000100:00100000:3.0:1788587046.957353:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587046.957821:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309898624 00000100:00100000:3.0:1788587046.957830:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309898624 00000100:00100000:3.0:1788587046.957873:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587046.957881:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309898624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587046.957934:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309898624:12345-0@lo:400:kworker.0 Request processed in 53us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587046.957940:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587046.957974:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309898368:0@lo:400:kworker.0 00000100:00100000:3.0:1788587046.958006:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309898624:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.959630:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309898496:12345-0@lo:400:kworker.0 Request processed in 4333us (4534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587046.959645:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788587046.961073:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309898496:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.961372:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309898752:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.961593:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587046.961823:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309898752 00000100:00100000:3.0:1788587046.961831:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309898752 00000100:00100000:3.0:1788587046.961892:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587046.961903:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309898752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.962125:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309898880:0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.962158:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587046.962263:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309898752:12345-0@lo:400:kworker.0 Request processed in 361us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587046.962297:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587046.962323:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309898880 00000100:00100000:3.0:1788587046.962327:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309898880 00000100:00100000:1.0:1788587046.962530:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309898752:0@lo:400:kworker.0 00000100:00100000:3.0:1788587046.962588:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587046.962596:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309898880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587046.962646:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309898880:12345-0@lo:400:kworker.0 Request processed in 51us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587046.962653:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587046.962715:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309898880:0@lo:400:kworker.0 00000100:00100000:2.0:1788587046.963120:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309899136:0@lo:400:kworker.0 00000100:00100000:2.0:1788587046.963157:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587046.963179:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309899648:0@lo:400:kworker.0 00000100:00100000:2.0:1788587046.963198:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587046.963214:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788587046.963220:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309899008:0@lo:400:kworker.0 00000100:00100000:2.0:1788587046.963239:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587046.963252:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309899520:0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.963401:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309899136 00000100:00100000:0.0:1788587046.963408:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309899136 00000100:00100000:0.0:1788587046.963455:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309899648 00000100:00100000:0.0:1788587046.963459:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309899648 00000100:00100000:0.0:1788587046.963471:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309899008 00000100:00100000:0.0:1788587046.963473:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309899008 00000100:00100000:0.0:1788587046.963487:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788587046.963494:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309899136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.963541:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309899136:12345-0@lo:400:kworker.0 Request processed in 48us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587046.963548:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788587046.963561:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788587046.963578:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309899648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.963607:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309899648:12345-0@lo:400:kworker.0 Request processed in 31us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587046.963613:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788587046.963624:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587046.963630:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309899008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.963652:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309899008:12345-0@lo:400:kworker.0 Request processed in 23us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587046.963658:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788587046.965455:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587046.965464:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587046.966781:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788587046.966869:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18715180 x1875469309899136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587046.966883:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309899136:0@lo:400:kworker.0 00010000:00080000:2.0:1788587046.966914:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18715f80 x1875469309899648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587046.966922:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309899648:0@lo:400:kworker.0 00000100:00100000:2.0:1788587046.966949:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309899008:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.967044:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309899520 00000100:00100000:1.0:1788587046.967060:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309899520 00000100:00100000:1.0:1788587046.967127:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587046.967137:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309899520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.967204:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309899520:12345-0@lo:400:kworker.0 Request processed in 69us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587046.967211:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587046.967251:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309899520:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.967357:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309899392:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.967396:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587046.967485:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309899904:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.967639:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587046.967671:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788587046.967679:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309899264:0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.967820:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309899392 00000100:00100000:0.0:1788587046.967826:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309899392 00000100:00100000:0.0:1788587046.967858:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309899904 00000100:00100000:0.0:1788587046.967861:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309899904 00000100:00100000:0.0:1788587046.967881:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587046.967888:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309899392:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788587046.967982:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587046.967987:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587046.967990:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587046.968017:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587046.968026:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309899904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587046.968260:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309899392:12345-0@lo:400:kworker.0 Request processed in 372us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587046.968384:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587046.968440:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587046.968481:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309899776:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.968506:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587046.968769:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309899264 00000100:00100000:0.0:1788587046.968776:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309899264 00000100:00100000:2.0:1788587046.968916:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309899904:12345-0@lo:400:kworker.0 Request processed in 891us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587046.968924:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587046.968941:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587046.968948:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309899264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587046.968977:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309899264:12345-0@lo:400:kworker.0 Request processed in 31us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587046.968982:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788587046.969037:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587046.969165:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18715c00 x1875469309899392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587046.969177:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309899392:0@lo:400:kworker.0 00010000:00080000:1.0:1788587046.969190:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18714000 x1875469309899904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587046.969198:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309899904:0@lo:400:kworker.0 00010000:00080000:1.0:1788587046.969221:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18716300 x1875469309899264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587046.969228:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309899264:0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.969246:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309899776 00000100:00100000:1.0:1788587046.969249:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309899776 00000100:00100000:1.0:1788587046.969289:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587046.969296:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309899776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587046.969522:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309899776:12345-0@lo:400:kworker.0 Request processed in 215us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587046.969673:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788587046.969766:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788587046.969789:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18714a80 x1875469309899776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587046.969817:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309899776:0@lo:400:kworker.0 00010000:00010000:3.0:1788587047.339766:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587047.468080:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587047.468105:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309900032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587047.468178:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587047.468293:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309900032 00000100:00100000:3.0:1788587047.468301:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309900032 00000100:00100000:3.0:1788587047.468476:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587047.468498:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309900032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587047.468536:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587047.468588:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309900032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587047.468595:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788587047.468635:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd53800 x1875469309900032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587047.468667:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309900032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587047.469456:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587047.469471:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309900160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587047.469513:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587047.469567:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309900160 00000100:00100000:2.0:1788587047.469574:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309900160 00000100:00100000:2.0:1788587047.469610:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587047.469617:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309900160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587047.469632:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587047.470759:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309900160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1136us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587047.470770:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788587047.477000:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18714a80 x1875469309900160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587047.477063:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309900160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587048.363362:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587048.491320:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309900544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587048.491404:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587048.491485:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788587048.491492:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309900416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587048.491517:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587048.491536:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309900288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587048.491558:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587048.491593:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309900416 00000100:00100000:1.0:1788587048.491601:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309900416 00000100:00100000:1.0:1788587048.491646:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309900288 00000100:00100000:1.0:1788587048.491650:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309900288 00000100:00100000:1.0:1788587048.491668:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587048.491676:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309900416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587048.491714:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587048.491757:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309900416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587048.491764:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587048.491822:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587048.491830:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309900288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587048.491840:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587048.491876:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309900288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587048.491881:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788587048.491898:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587048.491925:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18716300 x1875469309900416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587048.491943:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309900416:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788587048.491955:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372ca80 x1875469309900288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587048.491968:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309900288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587048.495365:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309900544 00000100:00100000:3.0:1788587048.495381:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309900544 00000100:00100000:3.0:1788587048.495453:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587048.495463:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309900544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587048.495563:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587048.495946:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309900544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 483us (4539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587048.495955:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788587048.496251:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309900544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587049.003410:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587049.007672:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309900672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587049.007743:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587049.008477:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309900672 00000100:00100000:3.0:1788587049.008486:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309900672 00000100:00100000:3.0:1788587049.010213:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788587049.010230:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309900672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587049.010272:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587049.010358:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309900672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587049.010365:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587049.010385:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309900672:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587049.387815:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587050.132177:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587050.132319:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292017152 00000100:00100000:2.0:1788587050.132330:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292017152 00000100:00100000:2.0:1788587050.132387:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 241 00000100:00100000:2.0:1788587050.132397:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:6383:x1875469292017152:12345-192.168.203.14@tcp:101: 00010000:00010000:2.0:1788587050.132414:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587050.132431:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63438d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5711 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587050.132460:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63438d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5711 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587050.132470:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63438d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5711 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587050.132479:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045e00, rc 0) 00000100:00100000:2.0:1788587050.132540:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6383:x1875469292017152:12345-192.168.203.14@tcp:101: Request processed in 145us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587050.132547:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 241 00000100:00100000:1.0:1788587050.146332:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587050.146476:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292017280 00000100:00100000:3.0:1788587050.146488:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292017280 00000100:00100000:3.0:1788587050.146545:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 242 00000100:00100000:3.0:1788587050.146556:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6383:x1875469292017280:12345-192.168.203.14@tcp:501: 00000100:00100000:3.0:1788587050.146912:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6383:x1875469292017280:12345-192.168.203.14@tcp:501: Request processed in 357us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.146920:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 242 00000100:00100000:0.0:1788587050.153748:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587050.153844:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292017408 00000100:00100000:3.0:1788587050.153866:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292017408 00000100:00100000:3.0:1788587050.153921:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 243 00000100:00100000:3.0:1788587050.153941:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6383:x1875469292017408:12345-192.168.203.14@tcp:503: 00000100:00100000:3.0:1788587050.154480:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6383:x1875469292017408:12345-192.168.203.14@tcp:503: Request processed in 540us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.154488:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 243 00000100:00100000:0.0:1788587050.175550:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587050.176725:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292017536 00000100:00100000:3.0:1788587050.176738:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292017536 00000100:00100000:3.0:1788587050.176835:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 244 00000100:00100000:3.0:1788587050.176846:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6893:x1875469292017536:12345-192.168.203.14@tcp:502: 00000100:00100000:3.0:1788587050.178254:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6893:x1875469292017536:12345-192.168.203.14@tcp:502: Request processed in 1402us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.178266:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 244 00000100:00100000:1.0:1788587050.183940:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587050.184092:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292017664 00000100:00100000:3.0:1788587050.184102:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292017664 00000100:00100000:3.0:1788587050.184165:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 245 00000100:00100000:3.0:1788587050.184175:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6893:x1875469292017664:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587050.184590:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6893:x1875469292017664:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 415us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.184600:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 245 00000100:00100000:0.0:1788587050.187615:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587050.187725:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292017792 00000100:00100000:2.0:1788587050.187737:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292017792 00000100:00100000:2.0:1788587050.187789:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 246 00000100:00100000:2.0:1788587050.187823:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6383:x1875469292017792:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587050.187838:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587050.187861:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044600/0x419e1ae1f63438e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5718 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587050.187891:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044600/0x419e1ae1f63438e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5718 expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587050.187904:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044600/0x419e1ae1f63438e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5718 expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587050.187915:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044600, rc 0) 00000100:00100000:2.0:1788587050.187991:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6383:x1875469292017792:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 194us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587050.187998:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 246 00000100:00100000:0.0:1788587050.195642:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587050.195949:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292017920 00000100:00100000:3.0:1788587050.196075:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292017920 00000100:00100000:3.0:1788587050.196146:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 247 00000100:00100000:3.0:1788587050.196158:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6383:x1875469292017920:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.196438:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6383:x1875469292017920:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 281us (805us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587050.196453:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 247 00010000:00010000:3.0:1788587050.411749:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587051.155609:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587051.155654:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587051.155690:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587051.155719:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587051.155743:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587051.155770:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292018560 00000100:00100000:1.0:1788587051.155780:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292018560 00000100:00100000:1.0:1788587051.155864:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292018432 00000100:00100000:1.0:1788587051.155867:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292018432 00000100:00100000:1.0:1788587051.155890:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788587051.155997:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292018304 00000100:00100000:3.0:1788587051.156001:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292018304 00000100:00100000:3.0:1788587051.156042:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292018176 00000100:00100000:3.0:1788587051.156046:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292018176 00000100:00100000:3.0:1788587051.156066:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:3.0:1788587051.156076:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292018304:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587051.156148:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292018304:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 73us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587051.156155:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:3.0:1788587051.156172:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:3.0:1788587051.156178:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292018176:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587051.156202:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292018176:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587051.156208:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:0.0:1788587051.156281:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292018048 00000100:00100000:0.0:1788587051.156286:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292018048 00000100:00100000:0.0:1788587051.156317:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 248 00000100:00100000:0.0:1788587051.156324:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292018048:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587051.156351:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292018048:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587051.156357:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 248 00000100:00080000:0.0:1788587051.156502:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587051.156506:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587051.156509:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587051.156511:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587051.156562:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292018560:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587051.156598:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292018560:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 40us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587051.157012:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788587051.157034:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292018432:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587051.157066:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292018432:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 47us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587051.157072:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:1.0:1788587051.162109:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00010000:00010000:3.0:1788587051.436634:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587052.090452:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309900800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.090610:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.090666:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309901312:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.090700:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.090725:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309901824:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.090766:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.090809:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309902336:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.090834:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.090861:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788587052.090870:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309901184:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.090895:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.090915:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309901696:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.090935:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.090952:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309902208:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.090984:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.091026:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309900928:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.091050:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.091071:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309901440:0@lo:400:kworker.0 00000100:00100000:3.0:1788587052.091084:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309900800 00000100:00100000:3.0:1788587052.091093:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309900800 00000100:00100000:0.0:1788587052.091098:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.091119:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309901952:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.091143:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587052.091147:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788587052.091166:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309900800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.091167:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788587052.091177:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309901056:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.091200:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587052.091247:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309900800:12345-0@lo:400:kworker.0 Request processed in 83us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587052.091255:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788587052.092320:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309901568:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.092371:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.092396:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309902080:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.092570:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.092621:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309901312 00000100:00100000:0.0:1788587052.092629:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309901312 00000100:00100000:0.0:1788587052.092663:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309901056 00000100:00100000:0.0:1788587052.092667:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309901056 00000100:00100000:0.0:1788587052.092687:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788587052.092695:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309901312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.092747:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309901312:12345-0@lo:400:kworker.0 Request processed in 52us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.092754:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788587052.092774:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587052.092781:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309901056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.092851:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309901056:12345-0@lo:400:kworker.0 Request processed in 70us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.092858:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587052.092882:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309901824 00000100:00100000:0.0:1788587052.092886:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309901824 00000100:00100000:0.0:1788587052.092921:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309902336 00000100:00100000:0.0:1788587052.092924:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309902336 00000100:00100000:0.0:1788587052.092944:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309901696 00000100:00100000:0.0:1788587052.092947:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309901696 00000100:00100000:0.0:1788587052.092966:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309902208 00000100:00100000:0.0:1788587052.092969:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309902208 00000100:00100000:0.0:1788587052.092993:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587052.093002:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309901824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.093048:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309901824:12345-0@lo:400:kworker.0 Request processed in 48us (2281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.093054:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587052.093066:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587052.093071:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309902336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.093099:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309902336:12345-0@lo:400:kworker.0 Request processed in 28us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.093104:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587052.093115:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587052.093120:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309901696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.093147:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309901696:12345-0@lo:400:kworker.0 Request processed in 26us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.093152:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587052.093163:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587052.093449:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309901056:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.094621:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309902208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.094703:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309902208:12345-0@lo:400:kworker.0 Request processed in 1526us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.094712:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587052.094761:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309901184 00000100:00100000:0.0:1788587052.094768:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309901184 00000100:00100000:0.0:1788587052.094816:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309900928 00000100:00100000:0.0:1788587052.094819:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309900928 00000100:00100000:0.0:1788587052.094833:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309901440 00000100:00100000:0.0:1788587052.094836:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309901440 00000100:00100000:0.0:1788587052.094850:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309901952 00000100:00100000:0.0:1788587052.094852:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309901952 00000100:00100000:0.0:1788587052.094862:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309901568 00000100:00100000:0.0:1788587052.094864:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309901568 00000100:00100000:0.0:1788587052.094875:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309902080 00000100:00100000:0.0:1788587052.094877:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309902080 00000100:00100000:0.0:1788587052.094889:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788587052.094895:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309901184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.094926:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309901184:12345-0@lo:400:kworker.0 Request processed in 31us (4030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.094932:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788587052.094943:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587052.094949:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309900928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.094978:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309900928:12345-0@lo:400:kworker.0 Request processed in 30us (3928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.094986:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587052.094997:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788587052.095003:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309901440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.095056:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309901440:12345-0@lo:400:kworker.0 Request processed in 53us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.095063:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788587052.095077:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788587052.095083:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309901952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.095115:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309901952:12345-0@lo:400:kworker.0 Request processed in 33us (3973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.095120:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788587052.095130:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788587052.095137:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309901568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.095168:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309901568:12345-0@lo:400:kworker.0 Request processed in 32us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.095174:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788587052.095185:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788587052.095192:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309902080:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788587052.095458:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd55500 x1875469309901568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587052.095472:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309901568:0@lo:400:kworker.0 00010000:00080000:3.0:1788587052.095489:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd54000 x1875469309902080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587052.095497:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309902080:0@lo:400:kworker.0 00000100:00100000:3.0:1788587052.095508:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309900928:0@lo:400:kworker.0 00000100:00100000:3.0:1788587052.095519:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309901440:0@lo:400:kworker.0 00000100:00100000:3.0:1788587052.095532:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309901952:0@lo:400:kworker.0 00000100:00100000:0.0:1788587052.096650:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309902080:12345-0@lo:400:kworker.0 Request processed in 1453us (4224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.096661:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788587052.096721:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587052.096727:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587052.096730:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587052.096733:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587052.097997:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309901184:0@lo:400:kworker.0 00010000:00080000:1.0:1788587052.098028:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd56680 x1875469309901696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587052.098039:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309901696:0@lo:400:kworker.0 00010000:00080000:1.0:1788587052.098052:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd55c00 x1875469309902208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587052.098060:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309902208:0@lo:400:kworker.0 00000100:00100000:1.0:1788587052.098069:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309900800:0@lo:400:kworker.0 00000100:00100000:1.0:1788587052.098079:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309901312:0@lo:400:kworker.0 00010000:00080000:1.0:1788587052.098089:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd54700 x1875469309901824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587052.098096:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309901824:0@lo:400:kworker.0 00010000:00080000:1.0:1788587052.098106:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacd180 x1875469309902336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587052.098113:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309902336:0@lo:400:kworker.0 00000020:00000080:2.0:1788587052.242887:0:9950:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcddee82d0 20000000:00000080:2.0:1788587052.242916:0:9950:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbf3ccee800 uarg=0000000000000000 20000000:01000000:2.0:1788587052.242950:0:9950:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587052.242956:0:9950:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587052.242961:0:9950:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788587052.245616:0:9951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788587052.246080:0:9950:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788587052.261327:0:9950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788587052.261386:0:9950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788587052.261444:0:9950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788587052.261463:0:9950:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788587052.261483:0:9950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261511:0:9950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cd800/0x419e1ae1f6343583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634357c expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261519:0:9950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634358a expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261526:0:9950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63435de expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261533:0:9950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261541:0:9950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261548:0:9950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261589:0:9950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261606:0:9950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 9 pid: 6465 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.261621:0:9950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902464:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587052.261721:0:9950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261730:0:9950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 23 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.261749:0:9950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902592:0@lo:104: 00000100:00100000:0.0:1788587052.261789:0:9950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587052.261847:0:9950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63435de expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261856:0:9950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63435de expref: 23 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.261864:0:9950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902720:0@lo:104: 00000100:00100000:0.0:1788587052.261891:0:9950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587052.261916:0:9950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634358a expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261923:0:9950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634358a expref: 23 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.261930:0:9950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902848:0@lo:104: 00010000:00010000:0.0:1788587052.261948:0:9950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cd800/0x419e1ae1f6343583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634357c expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.261955:0:9950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cd800/0x419e1ae1f6343583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634357c expref: 23 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.261962:0:9950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902976:0@lo:104: 00000100:00100000:0.0:1788587052.261976:0:9950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587052.262032:0:6456:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788587052.262048:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.262076:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.262093:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309902592 00000100:00100000:0.0:1788587052.262099:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309902592 00000100:00100000:0.0:1788587052.262130:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309902720 00000100:00100000:0.0:1788587052.262133:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309902720 00000100:00100000:0.0:1788587052.262141:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309902848 00000100:00100000:0.0:1788587052.262144:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309902848 00000100:00100000:0.0:1788587052.262154:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309902976 00000100:00100000:0.0:1788587052.262156:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309902976 00000100:00100000:0.0:1788587052.262168:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587052.262176:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+6:9950:x1875469309902592:12345-0@lo:104: 00010000:00010000:0.0:1788587052.262190:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262238:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587052.262244:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+6:9950:x1875469309902592:12345-0@lo:104: Request processed in 68us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.262250:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587052.262265:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587052.262271:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+5:9950:x1875469309902720:12345-0@lo:104: 00010000:00010000:0.0:1788587052.262278:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262309:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788587052.262314:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+5:9950:x1875469309902720:12345-0@lo:104: Request processed in 44us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.262320:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587052.262353:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587052.262359:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:9950:x1875469309902848:12345-0@lo:104: 00010000:00010000:0.0:1788587052.262366:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262403:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788587052.262409:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:9950:x1875469309902848:12345-0@lo:104: Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.262415:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587052.262430:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587052.262436:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:9950:x1875469309902976:12345-0@lo:104: 00010000:00010000:0.0:1788587052.262443:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262472:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788587052.262476:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:9950:x1875469309902976:12345-0@lo:104: Request processed in 41us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.262481:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788587052.262498:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788587052.262503:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262509:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587052.262513:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262521:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587052.262528:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587052.262534:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587052.262568:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262574:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587052.262592:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262599:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044e00/0x419e1ae1f6343704 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634370b expref: -99 pid: 9052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262611:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788587052.262614:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262619:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587052.262622:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262630:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587052.262635:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587052.262641:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587052.262653:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262659:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587052.262665:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262681:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63435de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63435e5 expref: -99 pid: 8097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262690:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587052.262693:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262699:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42045800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587052.262702:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262709:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587052.262715:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587052.262719:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587052.262734:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262739:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587052.262753:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262760:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f634358a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343591 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262770:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587052.262778:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262784:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587052.262787:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262814:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587052.262821:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587052.262826:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587052.262842:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262848:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587052.262854:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262861:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044a00/0x419e1ae1f634357c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343583 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.262873:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587052.262875:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587052.262877:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587052.262884:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587052.262903:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309903232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587052.262935:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.262958:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587052.262972:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309903104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587052.262995:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.263032:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309903360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587052.263054:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.263072:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587052.263078:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309903488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587052.263098:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587052.263117:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309903232 00000100:00100000:0.0:1788587052.263122:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309903232 00010000:00010000:0.0:1788587052.263145:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63435de expref: 24 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.263162:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309903104 00000100:00100000:0.0:1788587052.263164:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309903104 00010000:00010000:0.0:1788587052.263175:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 25 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.263185:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309903360 00000100:00100000:0.0:1788587052.263187:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309903360 00010000:00010000:0.0:1788587052.263196:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634358a expref: 26 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.263206:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309903488 00000100:00100000:0.0:1788587052.263208:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309903488 00010000:00010000:0.0:1788587052.263219:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cd800/0x419e1ae1f6343583 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634357c expref: 27 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.263231:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587052.263237:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+27:3473:x1875469309903232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587052.263247:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587052.263258:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63435de expref: 27 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.263267:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63435de expref: 27 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.263283:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587052.263313:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+27:3473:x1875469309903232:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.263319:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587052.263332:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587052.263337:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+26:3473:x1875469309903104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587052.263344:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587052.263348:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 26 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.263356:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 26 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.263364:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587052.263382:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+26:3473:x1875469309903104:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.263388:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587052.263399:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587052.263404:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+25:3474:x1875469309903360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587052.263410:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587052.263414:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634358a expref: 25 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.263431:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634358a expref: 25 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.263439:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587052.263464:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+25:3474:x1875469309903360:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.263470:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587052.263481:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587052.263487:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309903488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587052.263494:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587052.263498:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cd800/0x419e1ae1f6343583 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634357c expref: 24 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.263505:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cd800/0x419e1ae1f6343583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634357c expref: 24 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587052.263514:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587052.263532:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309903488:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587052.263538:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587052.263596:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309903488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587052.263605:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309903360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587052.263631:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309903104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587052.263638:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309903232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587052.263666:0:9950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482000/0x419e1ae1f634370b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343704 expref: 23 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.263683:0:9950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902592:0@lo:104: 00010000:00010000:0.0:1788587052.263696:0:9950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f63435e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63435de expref: 22 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.263703:0:9950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902720:0@lo:104: 00010000:00010000:0.0:1788587052.263710:0:9950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f6343591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634358a expref: 21 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.263717:0:9950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902848:0@lo:104: 00010000:00010000:0.0:1788587052.263725:0:9950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd800/0x419e1ae1f6343583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634357c expref: 20 pid: 6464 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587052.263732:0:9950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902976:0@lo:104: 00010000:00010000:2.0:1788587052.269346:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587052.269358:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587052.282248:0:9950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9950:1875469309902464:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587052.282249:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:0.0:1788587052.282292:0:9950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587052.282354:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292018688 00000100:00100000:2.0:1788587052.282362:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292018688 00010000:00010000:2.0:1788587052.282404:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 10 pid: 6465 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587052.282444:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788587052.282454:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2410:x1875469292018688:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587052.282470:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587052.282489:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 10 pid: 6465 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282510:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 10 pid: 6465 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282530:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37105200/0x419e1ae1f6343823 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d9 expref: 10 pid: 6465 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282547:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282555:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282571:0:6458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282578:0:6458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282585:0:6458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282591:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282597:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587052.282601:0:6458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282610:0:6458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282644:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587052.282655:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587052.282712:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:2410:x1875469292018688:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 258us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587052.282720:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00010000:00010000:1.0:1788587052.283322:0:9950:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587052.283337:0:9950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587052.283344:0:9950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482c00/0x419e1ae1f63438e7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587052.459442:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587052.594459:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309903616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587052.594529:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587052.594600:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587052.594607:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309903744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587052.594629:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587052.594666:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309903616 00000100:00100000:1.0:1788587052.594672:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309903616 00000100:00100000:1.0:1788587052.594721:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309903744 00000100:00100000:1.0:1788587052.594724:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309903744 00000100:00100000:1.0:1788587052.594740:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587052.594746:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309903616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587052.594779:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587052.594845:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309903616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587052.594854:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587052.594868:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587052.594875:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309903744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587052.594884:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587052.594906:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309903744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587052.594923:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788587052.594972:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc1f80 x1875469309903744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587052.594991:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309903744:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788587052.595002:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc2680 x1875469309903616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587052.595022:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309903616:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788587053.420468:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587053.420476:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe040c5800 from 4 10000000:01000000:0.0:1788587053.420481:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587053.420533:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587053.420546:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587053.420557:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587053.420615:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309903872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587053.420691:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.424191:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587053.424283:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309903872 00000100:00100000:3.0:1788587053.424293:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309903872 00000100:00100000:3.0:1788587053.424353:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788587053.424363:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309903872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587053.424379:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587053.424398:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63438ee expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.424443:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.424453:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.424463:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37104200, rc 0) 00000100:00100000:3.0:1788587053.424528:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309903872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (3837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.424535:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788587053.424790:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309903872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587053.424909:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587053.424919:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587053.424987:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587053.425033:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.425066:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.425116:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309904000 00000100:00100000:1.0:1788587053.425122:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309904000 00000100:00100000:1.0:1788587053.425159:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788587053.425167:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309904000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.425416:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309904000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.425423:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788587053.425521:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587053.425552:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587053.425588:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.425607:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587053.425644:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309904128 00000100:00100000:2.0:1788587053.425649:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309904128 00000100:00100000:2.0:1788587053.425676:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788587053.425682:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309904128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587053.425880:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309904128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587053.425887:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788587053.426139:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587053.426556:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9981:1875469309904256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587053.426597:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.426627:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587053.426673:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309904256 00000100:00100000:2.0:1788587053.426677:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309904256 00000100:00100000:2.0:1788587053.426718:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788587053.426726:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:9981:x1875469309904256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587053.427121:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:9981:x1875469309904256:12345-0@lo:502:llog_process_th.0 Request processed in 395us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587053.427130:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788587053.427222:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9981:1875469309904256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587053.427248:0:9981:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587053.427258:0:9981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587053.427260:0:9981:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587053.427266:0:9981:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe040c5800 00000020:00000080:1.0:1788587053.427268:0:9981:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788587053.427348:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9981:1875469309904384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587053.427383:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587053.427407:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309904384 00000100:00100000:1.0:1788587053.427411:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309904384 00000100:00100000:1.0:1788587053.427443:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788587053.427449:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:9981:x1875469309904384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587053.427560:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:9981:x1875469309904384:12345-0@lo:502:llog_process_th.0 Request processed in 111us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.427566:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788587053.427600:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.427611:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9981:1875469309904384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587053.427629:0:9981:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587053.427633:0:9981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587053.427635:0:9981:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788587053.427638:0:9981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788587053.428910:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788587053.428939:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587053.428949:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.428961:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587053.428971:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587053.428974:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf3d10b000 from 4 10000000:01000000:3.0:1788587053.428977:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587053.429020:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.429028:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.429038:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587053.429071:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587053.429119:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.429159:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf057b2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.430121:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309904512 00000100:00100000:1.0:1788587053.430131:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309904512 00000100:00100000:1.0:1788587053.430178:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788587053.430188:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309904512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587053.430202:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587053.430219:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63438fc expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.430244:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 22 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.430255:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 22 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.430264:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd400, rc 0) 00000100:00100000:1.0:1788587053.430328:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309904512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.430346:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788587053.430512:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587053.430530:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.430540:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587053.430601:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587053.430631:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.430666:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf057b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587053.430717:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309904640 00000100:00100000:0.0:1788587053.430723:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309904640 00000100:00100000:0.0:1788587053.430757:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788587053.430771:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309904640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587053.431301:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309904640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 529us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587053.431310:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788587053.431378:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587053.431411:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587053.431449:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.431475:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf057b2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.431526:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309904768 00000100:00100000:1.0:1788587053.431532:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309904768 00000100:00100000:1.0:1788587053.431569:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788587053.431576:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309904768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.431914:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309904768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 337us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.431922:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788587053.432126:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309904768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.440057:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9982:1875469309904896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587053.440147:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587053.440197:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587053.440411:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309904896 00000100:00100000:2.0:1788587053.440418:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309904896 00000100:00100000:2.0:1788587053.440462:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788587053.440471:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:9982:x1875469309904896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587053.440705:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:9982:x1875469309904896:12345-0@lo:502:llog_process_th.0 Request processed in 221us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587053.440722:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788587053.441549:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9982:1875469309904896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587053.441587:0:9982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587053.441599:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587053.441601:0:9982:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587053.441607:0:9982:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf3d10b000 00000020:00000080:1.0:1788587053.441610:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788587053.441690:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9982:1875469309905024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587053.441763:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.441949:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309905024 00000100:00100000:0.0:1788587053.441956:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309905024 00000100:00100000:0.0:1788587053.441989:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788587053.441999:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:9982:x1875469309905024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587053.442191:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:9982:x1875469309905024:12345-0@lo:502:llog_process_th.0 Request processed in 192us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587053.442198:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788587053.442769:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27104a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.442790:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9982:1875469309905024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587053.442856:0:9982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587053.442863:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587053.442866:0:9982:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788587053.442870:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788587053.443092:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788587053.443111:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587053.443121:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587053.443131:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587053.443141:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587053.443144:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf04818800 from 4 10000000:01000000:0.0:1788587053.443147:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587053.443176:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587053.443184:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587053.443192:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587053.443219:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587053.443260:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.443291:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587053.443367:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309905152 00000100:00100000:2.0:1788587053.443374:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309905152 00000100:00100000:2.0:1788587053.443414:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788587053.443422:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309905152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587053.443431:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587053.443443:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634390a expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587053.443463:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634390a expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587053.443473:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634390a expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587053.443482:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045800, rc 0) 00000100:00100000:2.0:1788587053.443515:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309905152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587053.443520:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788587053.448179:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587053.448213:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587053.448226:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587053.448305:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587053.448378:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587053.448422:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.448871:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309905280 00000100:00100000:1.0:1788587053.448886:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309905280 00000100:00100000:1.0:1788587053.448930:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788587053.448940:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309905280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.449215:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309905280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.449234:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788587053.449824:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587053.449871:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587053.449915:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587053.449939:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.451850:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309905408 00000100:00100000:1.0:1788587053.451862:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309905408 00000100:00100000:1.0:1788587053.451975:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788587053.451985:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309905408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.457429:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309905408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5434us (7502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.457445:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788587053.458025:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.458297:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587053.458324:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292018816 00000100:00100000:1.0:1788587053.458329:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292018816 00000100:00100000:1.0:1788587053.458366:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 263 00000100:00100000:1.0:1788587053.458374:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:6383:x1875469292018816:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587053.458389:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587053.458404:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd571f expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.458430:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.458440:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.458462:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cca00, rc 0) 00000100:00100000:1.0:1788587053.458505:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6383:x1875469292018816:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 131us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.458512:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 263 00000100:00100000:3.0:1788587053.459276:0:9985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9985:1875469309905536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587053.459332:0:9985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.459369:0:9985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf057b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.459457:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309905536 00000100:00100000:1.0:1788587053.459462:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309905536 00000100:00100000:1.0:1788587053.459498:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788587053.459506:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:9985:x1875469309905536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587053.459702:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:9985:x1875469309905536:12345-0@lo:502:llog_process_th.0 Request processed in 196us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.459710:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788587053.459827:0:9985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9985:1875469309905536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587053.459855:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587053.459865:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587053.459868:0:9985:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788587053.459875:0:9985:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf04818800 00000020:00000080:0.0:1788587053.459878:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788587053.459949:0:9985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9985:1875469309905664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587053.459984:0:9985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.460000:0:9985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.460135:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309905664 00000100:00100000:1.0:1788587053.460140:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309905664 00000100:00100000:1.0:1788587053.460164:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788587053.460169:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:9985:x1875469309905664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587053.460288:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:9985:x1875469309905664:12345-0@lo:502:llog_process_th.0 Request processed in 116us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.460294:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788587053.460572:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587053.460619:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292018944 00000100:00100000:3.0:1788587053.460628:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292018944 00000100:00100000:3.0:1788587053.460655:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 266 00000100:00100000:3.0:1788587053.460662:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6383:x1875469292018944:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587053.460881:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6383:x1875469292018944:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 219us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.460887:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 266 00000100:00100000:0.0:1788587053.461030:0:9985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9985:1875469309905664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587053.461056:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587053.461062:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587053.461064:0:9985:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788587053.461069:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788587053.461391:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788587053.461413:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587053.461423:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.461433:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587053.461444:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587053.461446:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf11802800 from 4 10000000:01000000:3.0:1788587053.461449:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587053.461477:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.461485:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587053.461493:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587053.461509:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587053.461544:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.461926:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf057b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.464916:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309905792 00000100:00100000:1.0:1788587053.464931:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309905792 00000100:00100000:1.0:1788587053.465292:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788587053.465301:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309905792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587053.465317:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587053.465333:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634391f expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.465370:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634391f expref: 24 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.465382:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634391f expref: 24 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.465392:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd000, rc 0) 00000100:00100000:1.0:1788587053.465516:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309905792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (3971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.465522:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788587053.465585:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587053.465602:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.465611:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587053.465672:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.465712:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587053.465739:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083f06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.465782:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587053.465820:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309905920 00000100:00100000:1.0:1788587053.465824:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309905920 00000100:00100000:1.0:1788587053.466112:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292019072 00000100:00100000:1.0:1788587053.466117:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292019072 00000100:00100000:1.0:1788587053.466134:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788587053.466140:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309905920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.466438:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309905920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.466445:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788587053.466466:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 269 00000100:00100000:1.0:1788587053.466740:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6383:x1875469292019072:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.469413:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6383:x1875469292019072:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 2930us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.469426:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 269 00000100:00100000:1.0:1788587053.469499:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309905920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.469550:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309906048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.469609:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587053.469643:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587053.469660:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309906048 00000100:00100000:1.0:1788587053.469666:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309906048 00000100:00100000:1.0:1788587053.469693:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788587053.469700:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309906048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587053.470151:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309906048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 449us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587053.470159:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788587053.470297:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309906048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587053.473187:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9987:1875469309906176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587053.474221:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587053.474257:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587053.475996:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309906176 00000100:00100000:3.0:1788587053.476020:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309906176 00000100:00100000:3.0:1788587053.476087:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788587053.476098:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:9987:x1875469309906176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587053.476361:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:9987:x1875469309906176:12345-0@lo:502:llog_process_th.0 Request processed in 264us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.476369:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788587053.476431:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9987:1875469309906176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587053.476465:0:9987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587053.476475:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587053.476477:0:9987:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788587053.476486:0:9987:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf11802800 00000020:00000080:3.0:1788587053.476488:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587053.476995:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9987:1875469309906304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587053.477051:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587053.477079:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309906304 00000100:00100000:2.0:1788587053.477085:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309906304 00000100:00100000:2.0:1788587053.477118:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788587053.477125:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:9987:x1875469309906304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587053.477262:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:9987:x1875469309906304:12345-0@lo:502:llog_process_th.0 Request processed in 137us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.477265:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf057b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587053.477269:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788587053.477277:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:9987:1875469309906304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587053.477295:0:9987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587053.477301:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587053.477302:0:9987:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788587053.477306:0:9987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788587053.477477:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788587053.477496:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587053.477506:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587053.477527:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587053.482238:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587053.482428:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292019200 00000100:00100000:3.0:1788587053.482438:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292019200 00000100:00100000:3.0:1788587053.482485:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 273 00000100:00100000:3.0:1788587053.482494:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6951:x1875469292019200:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587053.482786:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6951:x1875469292019200:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 291us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.482981:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 273 00010000:00010000:1.0:1788587053.483585:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587053.489916:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587053.490065:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292019328 00000100:00100000:2.0:1788587053.490075:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292019328 00000100:00100000:2.0:1788587053.490136:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 274 00000100:00100000:2.0:1788587053.490145:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6951:x1875469292019328:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587053.490383:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:6951:x1875469292019328:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 238us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587053.490392:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 274 00000100:00100000:2.0:1788587053.612962:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587053.612983:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309906432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587053.613068:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587053.613131:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309906432 00000100:00100000:2.0:1788587053.613139:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309906432 00000100:00100000:2.0:1788587053.613185:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587053.613193:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309906432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587053.613243:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587053.613289:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309906432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587053.613296:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788587053.613337:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18716d80 x1875469309906432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587053.613356:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309906432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587053.616117:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309906688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587053.616181:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.616253:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309906688 00000100:00100000:0.0:1788587053.616260:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309906688 00000100:00100000:0.0:1788587053.616300:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587053.616309:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309906688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587053.616346:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587053.616392:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309906688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587053.616404:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587053.616452:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309906688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587053.616617:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309906560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587053.616651:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587053.616734:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309906560 00000100:00100000:0.0:1788587053.616739:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309906560 00000100:00100000:0.0:1788587053.616821:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587053.616829:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309906560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587053.616843:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587053.616880:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309906560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587053.616886:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788587053.620532:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372ca80 x1875469309906560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587053.620561:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309906560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587054.123211:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309906816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587054.123346:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587054.123584:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309906816 00000100:00100000:2.0:1788587054.123592:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309906816 00000100:00100000:2.0:1788587054.123634:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587054.123641:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309906816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587054.123677:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587054.123723:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309906816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587054.123729:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587054.126514:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309906816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587054.508119:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587055.531142:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587056.273907:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587056.273936:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587056.273965:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587056.274004:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587056.274039:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292019584 00000100:00100000:0.0:1788587056.274050:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292019584 00000100:00100000:3.0:1788587056.274103:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292019840 00000100:00100000:3.0:1788587056.274110:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292019840 00000100:00100000:0.0:1788587056.274110:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292019712 00000100:00100000:0.0:1788587056.274116:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292019712 00000100:00100000:0.0:1788587056.274153:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:3.0:1788587056.274159:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:0.0:1788587056.274167:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292019584:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587056.274174:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292019840:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587056.274204:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587056.274256:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292019584:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 93us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587056.274264:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:0.0:1788587056.274281:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:0.0:1788587056.274287:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292019712:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587056.275053:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292019456 00000100:00100000:1.0:1788587056.275059:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292019456 00000100:00100000:1.0:1788587056.275097:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 275 00000100:00100000:1.0:1788587056.275103:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292019456:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587056.279314:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292019840:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 5133us (5364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587056.279329:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:3.0:1788587056.279363:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292019968 00000100:00100000:3.0:1788587056.279372:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292019968 00000100:00100000:3.0:1788587056.279422:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:3.0:1788587056.279432:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292019968:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587056.279850:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292019712:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 5559us (5841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587056.279862:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:3.0:1788587056.279886:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292019968:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 453us (5681us total) trans 0 rc 0/0 00000100:00080000:0.0:1788587056.279894:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587056.279896:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00080000:0.0:1788587056.279900:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587056.279904:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587056.279907:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587056.281862:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292019456:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 6748us (7884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587056.281885:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 275 00010000:00010000:3.0:1788587056.559491:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587057.195099:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587057.195122:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309906944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587057.195207:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587057.195263:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309906944 00000100:00100000:0.0:1788587057.195269:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309906944 00000100:00100000:0.0:1788587057.195315:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788587057.195322:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309906944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587057.195364:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309906944:12345-0@lo:400:kworker.0 Request processed in 43us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587057.195371:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788587057.195404:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309906944:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195755:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309907456:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195781:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.195809:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309907968:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195826:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.195837:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309908480:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195848:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.195860:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788587057.195864:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309907072:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195876:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.195886:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309907584:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195896:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.195904:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309908096:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195914:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.195930:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309907200:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195942:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.195952:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309907712:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.195962:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.195971:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309908224:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.196123:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.196140:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788587057.196146:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309907328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.196636:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.196652:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309907840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.196676:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.196691:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309908352:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.196711:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587057.196742:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309907456 00000100:00100000:2.0:1788587057.196748:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309907456 00000100:00100000:2.0:1788587057.196773:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309907200 00000100:00100000:2.0:1788587057.196775:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309907200 00000100:00100000:2.0:1788587057.196788:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788587057.196810:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309907456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.196854:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309907456:12345-0@lo:400:kworker.0 Request processed in 60us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.196861:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788587057.196876:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788587057.196882:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309907200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.196910:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309907200:12345-0@lo:400:kworker.0 Request processed in 28us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.196916:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788587057.201692:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309908480 00000100:00100000:2.0:1788587057.201708:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309908480 00000100:00100000:0.0:1788587057.201813:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309907968 00000100:00100000:0.0:1788587057.201819:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309907968 00000100:00100000:2.0:1788587057.201897:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309907840 00000100:00100000:2.0:1788587057.201901:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309907840 00000100:00080000:1.0:1788587057.201944:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587057.201949:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587057.202060:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309908352 00000100:00100000:0.0:1788587057.202064:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309908352 00000100:00100000:0.0:1788587057.202085:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587057.202095:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309908480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587057.202408:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309908480:12345-0@lo:400:kworker.0 Request processed in 313us (6556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587057.202416:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587057.202453:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587057.202460:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309907968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587057.202494:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309907968:12345-0@lo:400:kworker.0 Request processed in 35us (6665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587057.202501:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587057.202668:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587057.202676:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309908352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587057.202707:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309908352:12345-0@lo:400:kworker.0 Request processed in 32us (5994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587057.202714:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587057.202828:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587057.202843:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309907840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.202879:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309907840:12345-0@lo:400:kworker.0 Request processed in 37us (6202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.202885:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587057.202909:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309907072 00000100:00100000:2.0:1788587057.202914:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309907072 00000100:00100000:2.0:1788587057.202935:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309907584 00000100:00100000:2.0:1788587057.202938:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309907584 00000100:00100000:2.0:1788587057.202952:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309908096 00000100:00100000:2.0:1788587057.202955:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309908096 00000100:00100000:2.0:1788587057.202968:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309907712 00000100:00100000:2.0:1788587057.202971:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309907712 00000100:00100000:2.0:1788587057.202997:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309908224 00000100:00100000:2.0:1788587057.203000:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309908224 00000100:00100000:2.0:1788587057.203026:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309907328 00000100:00100000:2.0:1788587057.203029:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309907328 00000100:00100000:2.0:1788587057.203042:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788587057.203048:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309907072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203081:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309907072:12345-0@lo:400:kworker.0 Request processed in 33us (7202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.203087:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788587057.203098:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788587057.203105:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309907584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203127:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309907584:12345-0@lo:400:kworker.0 Request processed in 24us (7229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.203132:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788587057.203141:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587057.203145:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309908096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203179:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309908096:12345-0@lo:400:kworker.0 Request processed in 33us (7263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.203184:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587057.203490:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788587057.203497:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309907712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203529:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309907712:12345-0@lo:400:kworker.0 Request processed in 34us (7564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.203535:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788587057.203546:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788587057.203551:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309908224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203573:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309908224:12345-0@lo:400:kworker.0 Request processed in 22us (7563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.203577:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788587057.203585:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587057.203590:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309907328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203609:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309907328:12345-0@lo:400:kworker.0 Request processed in 20us (6974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587057.203614:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587057.203667:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309907328:0@lo:400:kworker.0 00010000:00080000:2.0:1788587057.203681:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdc700 x1875469309907840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587057.203691:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309907840:0@lo:400:kworker.0 00010000:00080000:2.0:1788587057.203700:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06895180 x1875469309908352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587057.203718:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309908352:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203729:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309907200:0@lo:400:kworker.0 00010000:00080000:2.0:1788587057.203738:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdf800 x1875469309907712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587057.203745:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309907712:0@lo:400:kworker.0 00010000:00080000:2.0:1788587057.203753:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06896d80 x1875469309908224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587057.203761:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309908224:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203819:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309907072:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203829:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309907584:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203838:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309908096:0@lo:400:kworker.0 00000100:00100000:2.0:1788587057.203849:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309907456:0@lo:400:kworker.0 00010000:00080000:2.0:1788587057.203858:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06895f80 x1875469309907968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587057.203867:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309907968:0@lo:400:kworker.0 00010000:00080000:2.0:1788587057.203875:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06896300 x1875469309908480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587057.203882:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309908480:0@lo:400:kworker.0 00000100:00080000:1.0:1788587057.204608:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587057.204614:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587057.204617:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788587057.580565:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587057.713059:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309908608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587057.713127:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587057.713401:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309908608 00000100:00100000:3.0:1788587057.713410:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309908608 00000100:00100000:3.0:1788587057.713457:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587057.713467:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309908608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587057.713503:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587057.713553:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309908608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587057.713561:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788587057.713600:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06895c00 x1875469309908608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587057.713628:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309908608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587057.713783:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309908736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587057.713845:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587057.713928:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309908736 00000100:00100000:0.0:1788587057.713934:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309908736 00000100:00100000:0.0:1788587057.713965:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587057.713972:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309908736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587057.713993:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587057.714029:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309908736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587057.714035:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788587057.714063:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34194a80 x1875469309908736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587057.714076:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309908736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788587058.602936:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587058.731206:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309908864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587058.731276:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587058.731346:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309908864 00000100:00100000:0.0:1788587058.731353:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309908864 00000100:00100000:0.0:1788587058.731405:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587058.731412:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309908864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587058.731447:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587058.731493:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309908864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587058.731501:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788587058.731541:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34194a80 x1875469309908864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587058.731561:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309908864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587058.731681:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587058.731691:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309908992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587058.731724:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587058.732021:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309908992 00000100:00100000:2.0:1788587058.732026:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309908992 00000100:00100000:2.0:1788587058.732069:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587058.732076:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309908992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587058.732101:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587058.732141:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309908992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587058.732147:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587058.732177:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309908992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587058.732382:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587058.732392:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309909120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587058.732429:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587058.732538:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309909120 00000100:00100000:0.0:1788587058.732542:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309909120 00000100:00100000:0.0:1788587058.732575:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587058.732581:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309909120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587058.732593:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587058.732738:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309909120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587058.732744:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788587058.732836:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34194a80 x1875469309909120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587058.732851:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309909120:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788587058.802091:0:10251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788587059.243202:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309909248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587059.243274:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587059.243431:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309909248 00000100:00100000:2.0:1788587059.243440:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309909248 00000100:00100000:2.0:1788587059.243481:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587059.243491:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309909248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587059.243529:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587059.243579:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309909248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587059.243586:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587059.243626:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309909248:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587059.627896:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587060.653535:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587061.410004:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587061.410165:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587061.410187:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587061.410208:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587061.410274:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587061.410298:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292020096 00000100:00100000:3.0:1788587061.410306:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292020096 00000100:00100000:3.0:1788587061.410349:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 277 00000100:00100000:3.0:1788587061.410359:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292020096:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587061.410426:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292020096:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587061.410434:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 277 00000100:00100000:2.0:1788587061.411162:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292020480 00000100:00100000:2.0:1788587061.411232:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292020480 00000100:00100000:2.0:1788587061.411277:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292020608 00000100:00100000:2.0:1788587061.411280:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292020608 00000100:00100000:2.0:1788587061.411301:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788587061.411309:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2408:x1875469292020480:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:2.0:1788587061.411336:0:8099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343838 00000100:00080000:2.0:1788587061.411354:0:8099:0:(import.c:65:import_set_state_nolock()) ffff8cbf0493c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587061.411395:0:8099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1788587061.412002:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587061.412331:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+2:2408:x1875469292020480:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 1018us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587061.412341:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788587061.412358:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788587061.412366:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2408:x1875469292020608:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:2.0:1788587061.412384:0:8099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634383f 00000100:00080000:2.0:1788587061.412391:0:8099:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdd7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587061.412415:0:8099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788587061.412839:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292020352 00000100:00100000:3.0:1788587061.412846:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292020352 00000100:00100000:3.0:1788587061.412883:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292020224 00000100:00100000:3.0:1788587061.412886:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292020224 00000100:00100000:3.0:1788587061.412910:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:3.0:1788587061.412917:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292020352:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587061.412960:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292020352:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 35us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587061.412968:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:3.0:1788587061.412989:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:3.0:1788587061.412996:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292020224:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587061.413106:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292020224:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 110us (2830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587061.413113:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:2.0:1788587061.413350:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+2:2408:x1875469292020608:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 983us (3184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587061.413357:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00080000:0.0:1788587061.414046:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587061.414053:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587061.414055:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587061.414057:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788587061.414071:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587061.676207:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587062.315291:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309909504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.315360:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.315422:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309910016:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.315445:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.315673:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309910528:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.315719:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.315751:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788587062.315757:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309909632:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.315787:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.315831:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309910144:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.315852:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.315867:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309910656:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.315887:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.315915:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309909504 00000100:00100000:1.0:1788587062.315924:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309909504 00000100:00100000:2.0:1788587062.317693:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309909376:0@lo:400:kworker.0 00000100:00100000:2.0:1788587062.317776:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587062.317848:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309909888:0@lo:400:kworker.0 00000100:00100000:2.0:1788587062.317875:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587062.317898:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309910400:0@lo:400:kworker.0 00000100:00100000:2.0:1788587062.317920:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587062.317938:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309910912:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.318130:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309910016 00000100:00100000:1.0:1788587062.318138:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309910016 00000100:00100000:1.0:1788587062.318172:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309910528 00000100:00100000:1.0:1788587062.318175:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309910528 00000100:00100000:1.0:1788587062.318188:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309910144 00000100:00100000:1.0:1788587062.318191:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309910144 00000100:00100000:1.0:1788587062.318218:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309910656 00000100:00100000:1.0:1788587062.318221:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309910656 00000100:00100000:1.0:1788587062.318239:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788587062.318248:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309909504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587062.318384:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587062.318386:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309909632 00000100:00100000:3.0:1788587062.318392:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309909632 00000100:00100000:0.0:1788587062.318397:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309910016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.318418:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309909888 00000100:00100000:3.0:1788587062.318423:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309909888 00000100:00100000:3.0:1788587062.318438:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788587062.318446:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309909632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.318495:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309909504:12345-0@lo:400:kworker.0 Request processed in 246us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587062.318501:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309909632:12345-0@lo:400:kworker.0 Request processed in 54us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587062.318508:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587062.318513:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587062.318535:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587062.318537:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587062.318548:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309910528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.318550:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309909888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.318597:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309909888:12345-0@lo:400:kworker.0 Request processed in 52us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587062.318603:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788587062.318628:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309909760:0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.318659:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.318676:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309910528:12345-0@lo:400:kworker.0 Request processed in 130us (2954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587062.318682:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309910272:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.318687:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587062.318703:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309909760 00000100:00100000:1.0:1788587062.318708:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309909760 00000100:00100000:3.0:1788587062.318713:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.318730:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788587062.318739:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309910784:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.318740:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309910144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.318776:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587062.318790:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309910144:12345-0@lo:400:kworker.0 Request processed in 52us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587062.318816:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587062.318834:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587062.318841:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309910656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.318859:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309910400 00000100:00100000:3.0:1788587062.318865:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309910400 00000100:00100000:1.0:1788587062.318875:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309910656:12345-0@lo:400:kworker.0 Request processed in 34us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587062.318883:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587062.318898:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587062.318899:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309910272 00000100:00100000:3.0:1788587062.318904:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309910272 00000100:00100000:1.0:1788587062.318908:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309909760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.318924:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309910784 00000100:00100000:3.0:1788587062.318928:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309910784 00000100:00100000:3.0:1788587062.318959:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788587062.318968:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309909760:12345-0@lo:400:kworker.0 Request processed in 62us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587062.318975:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587062.319142:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309910400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.319182:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309909632:0@lo:400:kworker.0 00010000:00080000:1.0:1788587062.319196:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06894a80 x1875469309910144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587062.319206:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309910144:0@lo:400:kworker.0 00010000:00080000:1.0:1788587062.319215:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06896300 x1875469309910656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587062.319223:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309910656:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.319235:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309909504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.319247:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309910528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.319259:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309910400:12345-0@lo:400:kworker.0 Request processed in 120us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587062.319268:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587062.319297:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587062.319305:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309910272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.319334:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309910272:12345-0@lo:400:kworker.0 Request processed in 32us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587062.319341:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587062.319352:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587062.319358:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309910784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.319385:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309910784:12345-0@lo:400:kworker.0 Request processed in 28us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587062.319391:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587062.319414:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309909376 00000100:00100000:3.0:1788587062.319419:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309909376 00000100:00100000:3.0:1788587062.319455:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788587062.319461:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309909376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.319491:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309909376:12345-0@lo:400:kworker.0 Request processed in 30us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587062.319508:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788587062.319546:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309909760:0@lo:400:kworker.0 00010000:00080000:3.0:1788587062.319557:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06894000 x1875469309910272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587062.319566:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309910272:0@lo:400:kworker.0 00010000:00080000:3.0:1788587062.319576:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06895f80 x1875469309910784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587062.319583:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309910784:0@lo:400:kworker.0 00000100:00080000:3.0:1788587062.319652:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587062.319657:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587062.319659:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587062.319662:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587062.330829:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587062.330915:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309909376:0@lo:400:kworker.0 00000100:00100000:3.0:1788587062.330932:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309909888:0@lo:400:kworker.0 00010000:00080000:3.0:1788587062.330954:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06897480 x1875469309910400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587062.330965:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309910400:0@lo:400:kworker.0 00000100:00100000:0.0:1788587062.331443:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309910016:12345-0@lo:400:kworker.0 Request processed in 13046us (15991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587062.331463:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587062.331650:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309910016:0@lo:400:kworker.0 00000100:00100000:1.0:1788587062.332116:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309910912 00000100:00100000:1.0:1788587062.332124:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309910912 00000100:00100000:1.0:1788587062.332259:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587062.332268:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309910912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587062.332566:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309910912:12345-0@lo:400:kworker.0 Request processed in 297us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587062.332575:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788587062.332637:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06894380 x1875469309910912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587062.332650:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309910912:0@lo:400:kworker.0 00000100:00080000:2.0:1788587062.332722:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788587062.701865:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587062.833610:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309911168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587062.834053:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309911040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587062.834320:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587062.838540:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587062.838669:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309911040 00000100:00100000:0.0:1788587062.838681:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309911040 00000100:00100000:0.0:1788587062.838729:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309911168 00000100:00100000:0.0:1788587062.838732:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309911168 00000100:00100000:0.0:1788587062.838747:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587062.838756:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309911040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587062.838897:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587062.838965:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309911040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 209us (4645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587062.839146:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587062.839230:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587062.839237:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309911168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587062.839250:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587062.839502:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309911168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587062.839510:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788587062.840644:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e0bb80 x1875469309911040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587062.840668:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309911040:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788587062.840730:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34196d80 x1875469309911168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587062.840745:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309911168:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788587063.699695:0:10494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing yml_node 00010000:00010000:3.0:1788587063.723091:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587063.852275:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309911296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587063.852356:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587063.852426:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309911296 00000100:00100000:2.0:1788587063.852434:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309911296 00000100:00100000:2.0:1788587063.852474:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587063.852483:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309911296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587063.852514:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587063.852557:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309911296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587063.852564:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788587063.852603:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9d500 x1875469309911296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587063.852622:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309911296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587063.853838:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587063.853847:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309911424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587063.853850:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309911552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587063.857874:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587063.857987:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309911552 00000100:00100000:1.0:1788587063.857996:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309911552 00000100:00100000:1.0:1788587063.858051:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587063.858061:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309911552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587063.858110:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587063.858267:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309911552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 207us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587063.858274:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587063.858335:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309911552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587063.864986:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587063.868857:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309911424 00000100:00100000:0.0:1788587063.868871:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309911424 00000100:00100000:0.0:1788587063.869020:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587063.869030:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309911424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587063.869055:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587063.869130:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309911424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (4160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587063.869136:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788587063.869184:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34196d80 x1875469309911424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587063.869204:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309911424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587064.374133:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309911680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587064.377776:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587064.377889:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309911680 00000100:00100000:1.0:1788587064.377898:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309911680 00000100:00100000:1.0:1788587064.377958:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587064.377968:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309911680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587064.378010:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587064.378057:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309911680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587064.378064:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587064.378109:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309911680:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788587064.463813:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:0.0:1788587064.463822:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbf0493c800/12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:2.0:1788587064.465985:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0493c800/12266002-a8db-4050-aa6c-b9db12e6128d for lustre-OST0000 00000020:00000080:2.0:1788587064.466057:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf0493c000 for lustre-OST0000 00010000:00010000:3.0:1788587064.752011:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587065.771046:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788587065.942553:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:2.0:1788587065.942564:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbf3bdd4000/12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:2.0:1788587065.942592:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3bdd4000/12266002-a8db-4050-aa6c-b9db12e6128d for lustre-OST0001 00000020:00000080:2.0:1788587065.942639:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3bdd7000 for lustre-OST0001 00000100:00100000:3.0:1788587066.515771:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587066.515847:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587066.515886:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587066.515980:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292020992 00000100:00100000:1.0:1788587066.515980:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292020864 00000100:00100000:1.0:1788587066.515990:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292020864 00000100:00100000:2.0:1788587066.515995:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292020992 00000100:00100000:0.0:1788587066.516049:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292020736 00000100:00100000:0.0:1788587066.516053:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292020736 00000100:00100000:2.0:1788587066.516056:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:2.0:1788587066.516065:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292020992:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587066.516082:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 279 00000100:00100000:0.0:1788587066.516088:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2411:x1875469292020736:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587066.516156:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2411:x1875469292020736:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 68us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587066.516169:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 279 00000100:00100000:1.0:1788587066.518910:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:1.0:1788587066.518940:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292020864:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587066.520500:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292020992:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 4427us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587066.520513:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00080000:3.0:1788587066.521099:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587066.521439:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587066.525088:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292020864:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 6142us (9188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587066.525110:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 86 00010000:00010000:0.0:1788587066.796029:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587067.435331:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309912192:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435398:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435453:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309912704:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435477:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435501:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309913216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435520:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435592:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788587067.435598:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309912064:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435635:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435652:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309912576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435669:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435683:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309913088:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435733:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435766:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309911936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435848:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435867:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309912448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435889:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435900:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309912960:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435928:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435940:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788587067.435954:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309911808:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.435980:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.435999:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309912320:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.436018:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.436033:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309912832:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.436055:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.436071:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309913344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.436089:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.436121:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309912704 00000100:00100000:3.0:1788587067.436128:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309912704 00000100:00100000:2.0:1788587067.436347:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309912192 00000100:00100000:2.0:1788587067.436352:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309912192 00000100:00100000:2.0:1788587067.436381:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309912576 00000100:00100000:2.0:1788587067.436384:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309912576 00000100:00100000:2.0:1788587067.436398:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309913088 00000100:00100000:2.0:1788587067.436400:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309913088 00000100:00100000:2.0:1788587067.436410:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309911936 00000100:00100000:2.0:1788587067.436413:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309911936 00000100:00100000:2.0:1788587067.436421:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309912448 00000100:00100000:2.0:1788587067.436423:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309912448 00000100:00100000:2.0:1788587067.436432:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309912960 00000100:00100000:2.0:1788587067.436434:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309912960 00000100:00100000:2.0:1788587067.436449:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788587067.436458:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309912192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587067.436517:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309912192:12345-0@lo:400:kworker.0 Request processed in 61us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.436524:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788587067.436540:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788587067.436547:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309912576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587067.436575:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309912576:12345-0@lo:400:kworker.0 Request processed in 28us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.436580:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788587067.436600:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788587067.436606:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309913088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587067.436633:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309913088:12345-0@lo:400:kworker.0 Request processed in 28us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.436638:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788587067.436648:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788587067.436654:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309911936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587067.436692:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309911936:12345-0@lo:400:kworker.0 Request processed in 38us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.436698:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788587067.436709:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788587067.436727:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309912448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587067.436756:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309912448:12345-0@lo:400:kworker.0 Request processed in 42us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.436762:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788587067.436773:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788587067.436778:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309912960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587067.436820:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309912960:12345-0@lo:400:kworker.0 Request processed in 42us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.436826:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788587067.436954:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309913216 00000100:00100000:3.0:1788587067.436959:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309913216 00000100:00100000:3.0:1788587067.436974:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309912832 00000100:00100000:3.0:1788587067.436977:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309912832 00000100:00100000:3.0:1788587067.436988:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309913344 00000100:00100000:3.0:1788587067.436990:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309913344 00000100:00100000:3.0:1788587067.437001:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788587067.437007:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309912704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437041:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309912704:12345-0@lo:400:kworker.0 Request processed in 35us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.437047:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788587067.437062:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788587067.437067:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309913216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437092:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309913216:12345-0@lo:400:kworker.0 Request processed in 25us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.437098:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788587067.437108:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788587067.437124:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309912832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437152:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309912832:12345-0@lo:400:kworker.0 Request processed in 29us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.437170:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788587067.437184:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788587067.437190:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309913344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437217:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309913344:12345-0@lo:400:kworker.0 Request processed in 28us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.437223:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788587067.437256:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587067.437261:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587067.437263:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587067.437265:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788587067.437295:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e09180 x1875469309912832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587067.437310:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309912832:0@lo:400:kworker.0 00010000:00080000:3.0:1788587067.437323:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e0bb80 x1875469309913344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587067.437332:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309913344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437343:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309911936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437355:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309912448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437364:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309912960:0@lo:400:kworker.0 00010000:00080000:3.0:1788587067.437406:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e08380 x1875469309912576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587067.437429:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309912576:0@lo:400:kworker.0 00010000:00080000:3.0:1788587067.437443:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e09c00 x1875469309913088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587067.437450:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309913088:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437461:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309912192:0@lo:400:kworker.0 00010000:00080000:3.0:1788587067.437471:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e0ad80 x1875469309912704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587067.437479:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309912704:0@lo:400:kworker.0 00010000:00080000:3.0:1788587067.437488:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e0b100 x1875469309913216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587067.437497:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309913216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437548:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309912064 00000100:00100000:3.0:1788587067.437552:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309912064 00000100:00100000:3.0:1788587067.437572:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309912320 00000100:00100000:3.0:1788587067.437574:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309912320 00000100:00100000:3.0:1788587067.437585:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788587067.437590:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309912064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437640:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309912064:12345-0@lo:400:kworker.0 Request processed in 49us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.437646:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788587067.437658:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788587067.437664:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309912320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.437708:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309912320:12345-0@lo:400:kworker.0 Request processed in 44us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.437893:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309912064:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.438275:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788587067.438297:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309911808 00000100:00100000:3.0:1788587067.438301:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309911808 00000100:00100000:3.0:1788587067.438333:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788587067.438340:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309911808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.438372:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309911808:12345-0@lo:400:kworker.0 Request processed in 33us (2391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.438377:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788587067.438413:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309911808:0@lo:400:kworker.0 00000100:00100000:3.0:1788587067.438423:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309912320:0@lo:400:kworker.0 00000001:02000400:3.0:1788587067.526428:0:10689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:0.0:1788587067.819492:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587067.947716:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587067.947737:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309913472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587067.947842:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587067.948072:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309913472 00000100:00100000:2.0:1788587067.948080:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309913472 00000100:00100000:2.0:1788587067.948164:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788587067.948175:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309913472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587067.948233:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587067.948285:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309913472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.948293:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788587067.948306:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a6d80 x1875469309913472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587067.948327:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309913472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587067.948571:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309913600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587067.948605:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587067.948715:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309913600 00000100:00100000:1.0:1788587067.948721:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309913600 00000100:00100000:1.0:1788587067.948782:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587067.948823:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309913600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587067.948838:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587067.948880:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309913600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587067.948887:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788587067.949219:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e08000 x1875469309913600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587067.949613:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309913600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587068.843009:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587068.973032:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309913728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587068.973140:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587068.973561:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309913728 00000100:00100000:2.0:1788587068.973570:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309913728 00000100:00100000:2.0:1788587068.973627:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587068.973637:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309913728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587068.973671:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587068.973719:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309913728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587068.973726:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788587068.974050:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a5180 x1875469309913728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587068.974072:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309913728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587068.974386:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587068.974399:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309913856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587068.974437:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587068.974511:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309913856 00000100:00100000:2.0:1788587068.974516:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309913856 00000100:00100000:2.0:1788587068.974551:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587068.974558:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309913856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587068.974573:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587068.974605:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309913856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587068.974612:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788587068.974677:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a6300 x1875469309913856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587068.974691:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309913856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587068.974823:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309913984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587068.974853:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587068.974949:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309913984 00000100:00100000:1.0:1788587068.974954:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309913984 00000100:00100000:1.0:1788587068.974991:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587068.974998:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309913984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587068.975040:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587068.975123:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309913984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587068.975129:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788587068.975364:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309913984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587069.482998:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587069.483021:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309914112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587069.484303:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587069.484474:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309914112 00000100:00100000:1.0:1788587069.484483:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309914112 00000100:00100000:1.0:1788587069.484544:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587069.484554:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309914112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587069.484601:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587069.484688:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309914112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587069.484695:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587069.488994:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309914112:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587069.866938:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587070.258120:0:10786:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:0.0:1788587070.891840:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587071.634711:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587071.634765:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587071.634831:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587071.634877:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292021376 00000100:00100000:3.0:1788587071.634896:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292021376 00000100:00100000:3.0:1788587071.634955:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292021248 00000100:00100000:3.0:1788587071.634961:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292021248 00000100:00100000:3.0:1788587071.634989:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:3.0:1788587071.635000:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292021376:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587071.635076:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292021376:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587071.635083:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:3.0:1788587071.635101:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00100000:3.0:1788587071.635120:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292021248:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587071.635146:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292021248:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587071.635152:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00080000:3.0:1788587071.635169:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587071.635183:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587071.635454:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292021120 00000100:00100000:0.0:1788587071.635459:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292021120 00000100:00100000:0.0:1788587071.635540:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 281 00000100:00100000:0.0:1788587071.635547:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2410:x1875469292021120:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587071.635576:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2410:x1875469292021120:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 30us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587071.635583:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 281 00010000:00010000:3.0:1788587071.914927:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788587072.508511:0:10884:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:0.0:1788587072.558002:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309914240:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.558071:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587072.558331:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309914240 00000100:00100000:1.0:1788587072.558339:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309914240 00000100:00100000:1.0:1788587072.558387:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788587072.558396:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309914240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587072.558658:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309914240:12345-0@lo:400:kworker.0 Request processed in 263us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587072.558666:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788587072.558857:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309914368:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.558897:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309914240:0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.558900:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587072.558916:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309914752:0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.558928:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309914880:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.558942:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587072.558944:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587072.558999:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309914368 00000100:00100000:3.0:1788587072.559005:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309914368 00000100:00100000:3.0:1788587072.559034:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309914880 00000100:00100000:3.0:1788587072.559037:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309914880 00000100:00100000:0.0:1788587072.559045:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309915264:0@lo:400:kworker.0 00000100:00100000:3.0:1788587072.559064:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788587072.559071:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309914368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.559259:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309915392:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.559265:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587072.559281:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587072.559291:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309915776:0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.559292:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788587072.559297:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309914496:0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.559313:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587072.559313:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587072.559328:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788587072.559332:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309914624:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.559353:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587072.559365:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309915136:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.559382:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587072.559398:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309915648:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.559416:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587072.559427:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309914752 00000100:00100000:1.0:1788587072.559431:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309914752 00000100:00100000:1.0:1788587072.559450:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309914496 00000100:00100000:1.0:1788587072.559452:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309914496 00000100:00100000:1.0:1788587072.559463:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788587072.559469:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309914752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.559491:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309915392 00000100:00100000:0.0:1788587072.559495:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309915392 00000100:00100000:1.0:1788587072.559509:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309914752:12345-0@lo:400:kworker.0 Request processed in 39us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587072.559514:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309914624 00000100:00100000:1.0:1788587072.559516:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587072.559517:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309914624 00000100:00100000:1.0:1788587072.559527:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587072.559528:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788587072.559532:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309914496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.559533:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309914880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587072.559559:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309914496:12345-0@lo:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587072.559559:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309914880:12345-0@lo:400:kworker.0 Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587072.559565:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587072.559565:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788587072.559576:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788587072.559582:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309915392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587072.559589:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309914752:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.559606:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309915392:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587072.559612:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788587072.559623:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309915264 00000100:00100000:0.0:1788587072.559623:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788587072.559626:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309915264 00000100:00100000:0.0:1788587072.559629:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309914624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587072.559644:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309915776 00000100:00100000:1.0:1788587072.559647:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309915776 00000100:00100000:0.0:1788587072.559657:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309914624:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587072.559658:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309915136 00000100:00100000:1.0:1788587072.559660:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309915136 00000100:00100000:0.0:1788587072.559669:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788587072.559670:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309915648 00000100:00100000:1.0:1788587072.559672:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309915648 00000100:00100000:1.0:1788587072.559683:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587072.559689:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309915264:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788587072.559691:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587072.559695:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587072.559697:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587072.559706:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788587072.559712:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309915776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587072.559724:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309915264:12345-0@lo:400:kworker.0 Request processed in 35us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587072.559730:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788587072.559736:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309915776:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587072.559741:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788587072.559744:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587072.559747:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309915136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.559753:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587072.559758:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309915648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587072.559769:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309915136:12345-0@lo:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587072.559775:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788587072.559777:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309915648:12345-0@lo:400:kworker.0 Request processed in 20us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587072.559783:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587072.559839:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309915008:0@lo:400:kworker.0 00000100:00100000:1.0:1788587072.560200:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309914624:0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.560288:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587072.560354:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309915520:0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.560375:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587072.560541:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309914880:0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.560552:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309915392:0@lo:400:kworker.0 00000100:00100000:2.0:1788587072.560571:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309914496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587072.560575:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309914368:12345-0@lo:400:kworker.0 Request processed in 1504us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587072.560580:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309914368:0@lo:400:kworker.0 00000100:00100000:3.0:1788587072.560583:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788587072.560611:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309915008 00000100:00100000:1.0:1788587072.560616:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309915008 00000100:00100000:0.0:1788587072.560625:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309915520 00000100:00100000:0.0:1788587072.560628:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309915520 00000100:00100000:1.0:1788587072.560657:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788587072.560668:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309915008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.560686:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788587072.560692:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309915520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587072.560710:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309915008:12345-0@lo:400:kworker.0 Request processed in 48us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587072.560716:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788587072.560720:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309915520:12345-0@lo:400:kworker.0 Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587072.560725:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1788587072.560744:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e08380 x1875469309915008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788587072.560744:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e0a300 x1875469309915136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587072.560756:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309915008:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.560756:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309915136:0@lo:400:kworker.0 00010000:00080000:1.0:1788587072.560765:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e0bb80 x1875469309915520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788587072.560767:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e09180 x1875469309915648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587072.560773:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309915520:0@lo:400:kworker.0 00000100:00100000:0.0:1788587072.560783:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309915648:0@lo:400:kworker.0 00010000:00080000:0.0:1788587072.560817:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e09f80 x1875469309915264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587072.560825:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309915264:0@lo:400:kworker.0 00010000:00080000:0.0:1788587072.560836:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e08000 x1875469309915776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587072.560843:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309915776:0@lo:400:kworker.0 00000100:00080000:2.0:1788587072.560948:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788587072.939014:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587073.067231:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309915904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587073.067300:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587073.067708:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309915904 00000100:00100000:3.0:1788587073.067716:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309915904 00000100:00100000:3.0:1788587073.067764:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788587073.067774:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309915904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587073.067833:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587073.067897:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309915904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587073.067898:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309916032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587073.067911:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788587073.068324:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a7b80 x1875469309915904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587073.068343:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309915904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587073.072647:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587073.072777:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309916032 00000100:00100000:0.0:1788587073.072787:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309916032 00000100:00100000:0.0:1788587073.072849:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788587073.072859:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309916032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587073.072894:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587073.072956:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309916032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587073.072965:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788587073.073069:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2c700 x1875469309916032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587073.073102:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309916032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788587073.963053:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587074.055692:0:10932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 01:44:32 EDT 2026 00000100:00100000:2.0:1788587074.091092:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587074.091116:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309916160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587074.091185:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587074.091258:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309916160 00000100:00100000:2.0:1788587074.091265:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309916160 00000100:00100000:2.0:1788587074.091316:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587074.091325:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309916160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587074.091365:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587074.091414:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309916160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587074.091420:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587074.091461:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309916160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587074.092313:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309916288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587074.092355:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587074.092427:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309916288 00000100:00100000:2.0:1788587074.092434:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309916288 00000100:00100000:2.0:1788587074.092519:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587074.092527:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309916288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587074.092553:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587074.092602:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309916288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587074.092609:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587074.093261:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309916416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587074.093291:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587074.093329:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309916416 00000100:00100000:2.0:1788587074.093333:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309916416 00010000:00080000:1.0:1788587074.093852:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a7800 x1875469309916288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587074.093893:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309916288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587074.094466:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587074.094476:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309916416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587074.094497:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587074.094557:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309916416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1264us total) trans 0 rc 0/0 00000100:00080000:3.0:1788587074.094558:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587074.094563:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788587074.094633:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a4a80 x1875469309916416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587074.094648:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309916416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587074.603367:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309916544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587074.603439:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587074.603600:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309916544 00000100:00100000:2.0:1788587074.603608:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309916544 00000100:00100000:2.0:1788587074.604089:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788587074.604100:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309916544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587074.604138:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587074.604198:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309916544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587074.604205:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788587074.604281:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309916544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587074.990109:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587076.011027:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587076.756004:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587076.756056:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587076.756082:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587076.756109:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292021504 00000100:00100000:3.0:1788587076.756118:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292021504 00000100:00100000:3.0:1788587076.756175:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 283 00000100:00100000:3.0:1788587076.756185:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2411:x1875469292021504:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587076.756253:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2411:x1875469292021504:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 68us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587076.756259:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 283 00000100:00100000:1.0:1788587076.757474:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292021632 00000100:00100000:1.0:1788587076.757484:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292021632 00000100:00100000:1.0:1788587076.757542:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292021760 00000100:00100000:1.0:1788587076.757546:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292021760 00000100:00100000:1.0:1788587076.757572:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:1.0:1788587076.757581:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292021632:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587076.757633:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292021632:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 53us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587076.757639:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:1.0:1788587076.757654:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00100000:1.0:1788587076.757661:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292021760:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587076.757684:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292021760:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587076.757689:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00080000:1.0:1788587076.757713:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587076.757717:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587077.034987:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587077.676433:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587077.676522:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587077.676544:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309916800:0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.676621:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587077.677152:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309916800 00000100:00100000:2.0:1788587077.677161:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309916800 00000100:00100000:3.0:1788587077.677173:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309916672:0@lo:400:kworker.0 00000100:00100000:2.0:1788587077.677212:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788587077.677213:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587077.677221:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309916800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.677247:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309916672 00000100:00100000:3.0:1788587077.677251:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309916672 00000100:00100000:2.0:1788587077.677272:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309916800:12345-0@lo:400:kworker.0 Request processed in 52us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587077.677276:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788587077.677279:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788587077.677281:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309916672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.677314:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309916672:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587077.677320:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788587077.677354:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309916672:0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.677403:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309916800:0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.678539:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309916928:0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.678586:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587077.678878:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309916928 00000100:00100000:2.0:1788587077.678885:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309916928 00000100:00100000:2.0:1788587077.678932:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788587077.678946:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309916928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.679133:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309917056:0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.679164:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587077.679195:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309917056 00000100:00100000:3.0:1788587077.679200:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309917056 00000100:00100000:3.0:1788587077.679233:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788587077.679239:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309917056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.679273:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309917056:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587077.679280:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788587077.679317:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309917056:0@lo:400:kworker.0 00000100:00100000:2.0:1788587077.679423:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309916928:12345-0@lo:400:kworker.0 Request processed in 478us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587077.679429:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788587077.680423:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309917184:0@lo:400:kworker.0 00000100:00100000:2.0:1788587077.680466:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587077.680543:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309917184 00000100:00100000:3.0:1788587077.680550:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309917184 00000100:00100000:3.0:1788587077.680583:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587077.680591:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309917184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.681177:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309916928:0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.681232:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309917312:0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.681263:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587077.681300:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309917312 00000100:00100000:1.0:1788587077.681316:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309917312 00000100:00100000:1.0:1788587077.681354:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788587077.681362:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309917312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.681398:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309917312:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587077.681405:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788587077.681423:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587077.681443:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309917312:0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.682745:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309917184:12345-0@lo:400:kworker.0 Request processed in 2148us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587077.682757:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788587077.682985:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309917824:0@lo:400:kworker.0 00000100:00100000:0.0:1788587077.683050:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587077.683077:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788587077.683083:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309917696:0@lo:400:kworker.0 00000100:00100000:0.0:1788587077.683106:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587077.683124:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309918208:0@lo:400:kworker.0 00000100:00100000:0.0:1788587077.683146:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587077.683174:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309917696 00000100:00100000:0.0:1788587077.683180:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309917696 00000100:00100000:0.0:1788587077.683222:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309918208 00000100:00100000:0.0:1788587077.683225:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309918208 00000100:00100000:0.0:1788587077.683245:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587077.683252:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309917696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587077.683294:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309917696:12345-0@lo:400:kworker.0 Request processed in 42us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587077.683299:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788587077.683449:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309917568:0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.683476:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587077.683489:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309918080:0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.683541:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587077.683557:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788587077.683563:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309917440:0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.683584:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587077.683743:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309917952:0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.683767:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587077.683816:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309917824 00000100:00100000:3.0:1788587077.683821:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309917824 00000100:00100000:3.0:1788587077.683867:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309917440 00000100:00100000:3.0:1788587077.683871:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309917440 00000100:00100000:3.0:1788587077.683897:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309917952 00000100:00100000:3.0:1788587077.683900:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309917952 00000100:00100000:3.0:1788587077.683915:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788587077.683920:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309917824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.683968:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309917824:12345-0@lo:400:kworker.0 Request processed in 46us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587077.683975:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788587077.683988:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788587077.683994:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309917440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.684024:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309917440:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587077.684029:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788587077.684040:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788587077.684045:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309917952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.684072:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309917952:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587077.684077:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1788587077.684112:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34194700 x1875469309917440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587077.684125:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309917440:0@lo:400:kworker.0 00010000:00080000:3.0:1788587077.684136:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41745f80 x1875469309917952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587077.684144:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309917952:0@lo:400:kworker.0 00000100:00100000:3.0:1788587077.684194:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309917568 00000100:00100000:3.0:1788587077.684197:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309917568 00000100:00100000:2.0:1788587077.684301:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309917184:0@lo:400:kworker.0 00000100:00080000:2.0:1788587077.684332:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587077.684336:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587077.684339:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587077.684341:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587077.684365:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309918080 00000100:00100000:2.0:1788587077.684369:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309918080 00000100:00100000:2.0:1788587077.684489:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788587077.684498:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309918208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587077.684537:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309918208:12345-0@lo:400:kworker.0 Request processed in 40us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587077.684713:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788587077.684723:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587077.684727:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309917568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.684731:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788587077.684740:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309918080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788587077.684748:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587077.684774:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309917568:12345-0@lo:400:kworker.0 Request processed in 51us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587077.684783:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788587077.684784:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34197800 x1875469309917696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587077.684815:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309917696:0@lo:400:kworker.0 00010000:00080000:0.0:1788587077.684833:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34194a80 x1875469309917568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587077.684851:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309917568:0@lo:400:kworker.0 00010000:00080000:2.0:1788587077.684892:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36a14000 x1875469309918208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587077.684902:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309918208:0@lo:400:kworker.0 00000100:00100000:2.0:1788587077.684928:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309917824:0@lo:400:kworker.0 00000100:00100000:1.0:1788587077.686542:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309918080:12345-0@lo:400:kworker.0 Request processed in 1797us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587077.686554:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788587077.686628:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36a14700 x1875469309918080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587077.686641:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309918080:0@lo:400:kworker.0 00010000:00010000:2.0:1788587078.059111:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587078.187292:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587078.187315:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309918336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587078.187383:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587078.187477:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309918336 00000100:00100000:3.0:1788587078.187484:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309918336 00000100:00100000:3.0:1788587078.187535:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788587078.187545:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309918336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587078.187580:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587078.187626:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309918336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587078.187633:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788587078.187701:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2b100 x1875469309918336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587078.187730:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309918336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587078.188096:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587078.188106:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309918464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587078.188136:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587078.188165:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309918464 00000100:00100000:0.0:1788587078.188170:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309918464 00000100:00100000:0.0:1788587078.188196:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788587078.188203:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05734700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309918464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587078.188215:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587078.188246:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05734700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309918464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587078.188253:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788587078.188539:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2b480 x1875469309918464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587078.188553:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309918464:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788587079.083125:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587079.210989:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309918720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587079.211070:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587079.211143:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309918720 00000100:00100000:2.0:1788587079.211151:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309918720 00000100:00100000:2.0:1788587079.211211:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587079.211221:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309918720:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587079.211265:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309918592:0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1788587079.211267:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587079.211312:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587079.211339:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309918720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587079.211347:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788587079.211368:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309918592 00000100:00080000:2.0:1788587079.211373:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587079.211373:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309918592 00010000:00080000:2.0:1788587079.211405:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a4380 x1875469309918720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587079.211418:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788587079.211426:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309918592:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587079.211431:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309918720:0@lo:13:osp-pre-0-0.0 00000004:00000024:0.0:1788587079.211456:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587079.211498:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309918592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587079.211505:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587079.211516:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309918848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587079.211550:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587079.211581:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309918848 00000100:00100000:2.0:1788587079.211585:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309918848 00000100:00100000:2.0:1788587079.211614:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587079.211621:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309918848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587079.211632:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587079.211668:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309918592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587079.211676:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309918848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587079.211693:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788587079.211712:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788587079.211729:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a4380 x1875469309918848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587079.211743:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309918848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587079.728299:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309918976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587079.728370:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587079.729237:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309918976 00000100:00100000:1.0:1788587079.729247:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309918976 00000100:00100000:1.0:1788587079.729295:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587079.729304:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309918976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587079.729343:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587079.729404:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309918976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587079.729412:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788587079.729847:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309918976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788587080.107095:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587081.134152:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587081.874061:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587081.874106:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587081.874142:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587081.874170:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292021888 00000100:00100000:0.0:1788587081.874179:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292021888 00000100:00100000:0.0:1788587081.874224:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 285 00000100:00100000:0.0:1788587081.874233:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292021888:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587081.874292:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2412:x1875469292021888:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587081.874299:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 285 00000100:00100000:3.0:1788587081.874480:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292022016 00000100:00100000:3.0:1788587081.874485:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292022016 00000100:00100000:3.0:1788587081.874533:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292022144 00000100:00100000:3.0:1788587081.874537:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292022144 00000100:00100000:3.0:1788587081.874559:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 109 00000100:00100000:3.0:1788587081.874566:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292022016:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587081.874597:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292022016:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 33us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587081.874603:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 109 00000100:00100000:3.0:1788587081.874616:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:3.0:1788587081.874622:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292022144:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587081.874645:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292022144:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587081.874650:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00080000:0.0:1788587081.875004:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587081.875009:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587082.155394:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587082.795019:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587082.795269:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587082.795295:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309919488:0@lo:400:kworker.0 00000100:00100000:1.0:1788587082.795354:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587082.795413:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309919488 00000100:00100000:1.0:1788587082.795420:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309919488 00000100:00100000:1.0:1788587082.795461:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587082.795468:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309919488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587082.795515:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309919488:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587082.795522:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587082.795560:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309919488:0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.797578:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309919104:0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.797651:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587082.797700:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309919232:0@lo:400:kworker.0 00000100:00100000:1.0:1788587082.797722:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309919104 00000100:00100000:1.0:1788587082.797732:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309919104 00000100:00100000:2.0:1788587082.797745:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587082.797773:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587082.797780:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788587082.797783:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309919360:0@lo:400:kworker.0 00000100:00100000:1.0:1788587082.797822:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309919104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.797841:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587082.797884:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309919104:12345-0@lo:400:kworker.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587082.797892:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309919232 00000100:00100000:1.0:1788587082.797892:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788587082.797898:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309919232 00000100:00100000:2.0:1788587082.797936:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788587082.797936:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309919360 00000100:00100000:1.0:1788587082.797941:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309919360 00000100:00100000:2.0:1788587082.797947:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309919232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587082.797972:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587082.797981:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309919360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.797991:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309919232:12345-0@lo:400:kworker.0 Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587082.797999:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788587082.798020:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309919360:12345-0@lo:400:kworker.0 Request processed in 40us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587082.798028:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788587082.798042:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309919360:0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.798056:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309919232:0@lo:400:kworker.0 00000100:00100000:1.0:1788587082.798080:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309919104:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800363:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309920000:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800419:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587082.800450:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309920512:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800476:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587082.800493:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788587082.800498:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309919616:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800515:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587082.800529:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309920128:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800544:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587082.800555:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309920640:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800569:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587082.800590:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309920000 00000100:00100000:3.0:1788587082.800596:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309920000 00000100:00100000:3.0:1788587082.800629:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309920512 00000100:00100000:3.0:1788587082.800631:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309920512 00000100:00100000:3.0:1788587082.800640:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309920128 00000100:00100000:3.0:1788587082.800642:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309920128 00000100:00100000:3.0:1788587082.800652:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309920640 00000100:00100000:3.0:1788587082.800654:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309920640 00000100:00100000:3.0:1788587082.800666:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587082.800672:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309920000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800714:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309920000:12345-0@lo:400:kworker.0 Request processed in 42us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587082.800721:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587082.800736:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587082.800742:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309920512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800768:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309920512:12345-0@lo:400:kworker.0 Request processed in 27us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587082.800774:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587082.800785:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587082.800830:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309920128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800859:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309920128:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587082.800865:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587082.800876:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788587082.800882:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309920640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.800905:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309920640:12345-0@lo:400:kworker.0 Request processed in 24us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587082.800910:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788587082.800940:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d54380 x1875469309920128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587082.800954:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309920128:0@lo:400:kworker.0 00010000:00080000:3.0:1788587082.800963:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdc700 x1875469309920640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587082.800970:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309920640:0@lo:400:kworker.0 00010000:00080000:3.0:1788587082.800978:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d57800 x1875469309920000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587082.800985:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309920000:0@lo:400:kworker.0 00010000:00080000:3.0:1788587082.800992:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdf800 x1875469309920512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587082.801000:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309920512:0@lo:400:kworker.0 00000100:00080000:0.0:1788587082.801408:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587082.801412:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587082.801572:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309919616 00000100:00100000:1.0:1788587082.801583:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309919616 00000100:00100000:1.0:1788587082.801722:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587082.801730:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309919616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587082.801781:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309919616:12345-0@lo:400:kworker.0 Request processed in 53us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587082.801787:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788587082.801994:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309919616:0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.802208:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309919872:0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.802258:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587082.802295:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309920384:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.802299:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309919872 00000100:00100000:3.0:1788587082.802311:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309919872 00000100:00100000:2.0:1788587082.802321:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587082.802347:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788587082.802356:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309920384 00000100:00100000:2.0:1788587082.802356:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309919744:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.802362:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309920384 00000100:00100000:2.0:1788587082.802389:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587082.802393:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788587082.802402:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309919872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.802407:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309920256:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.802442:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309919872:12345-0@lo:400:kworker.0 Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587082.802451:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788587082.802456:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587082.802467:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309919744 00000100:00100000:3.0:1788587082.802471:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309919744 00000100:00100000:3.0:1788587082.802485:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309920256 00010000:00080000:2.0:1788587082.802486:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d54700 x1875469309919872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587082.802488:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309920256 00000100:00100000:2.0:1788587082.802501:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309919872:0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.802505:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788587082.802513:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309920384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.802537:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788587082.802547:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309920384:12345-0@lo:400:kworker.0 Request processed in 34us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587082.802551:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309919744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587082.802558:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788587082.802571:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788587082.802577:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309920256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587082.802603:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309919744:12345-0@lo:400:kworker.0 Request processed in 56us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587082.802614:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309920256:12345-0@lo:400:kworker.0 Request processed in 35us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587082.802614:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788587082.802624:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788587082.802670:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309919744:0@lo:400:kworker.0 00000100:00080000:0.0:1788587082.802674:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587082.802681:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309920256:0@lo:400:kworker.0 00000100:00080000:0.0:1788587082.802686:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788587082.802694:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdc000 x1875469309920384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587082.802702:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309920384:0@lo:400:kworker.0 00010000:00010000:3.0:1788587083.179044:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587083.307395:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587083.307416:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309920768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587083.307486:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587083.307548:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309920768 00000100:00100000:2.0:1788587083.307555:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309920768 00000100:00100000:2.0:1788587083.307598:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788587083.307606:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309920768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587083.307638:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587083.307677:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309920768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587083.307684:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788587083.307725:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34189500 x1875469309920768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587083.307742:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309920768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587083.308435:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587083.308449:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309920896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587083.308486:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587083.309770:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309920896 00000100:00100000:2.0:1788587083.309781:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309920896 00000100:00100000:2.0:1788587083.311249:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788587083.311264:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309920896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587083.311444:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587083.311514:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309920896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587083.311520:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788587083.311565:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdca80 x1875469309920896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587083.311585:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309920896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587084.203683:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587084.338968:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309921024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587084.339037:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587084.339981:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309921024 00000100:00100000:0.0:1788587084.339992:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309921024 00000100:00100000:0.0:1788587084.340048:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788587084.340058:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309921024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587084.340099:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587084.340162:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309921024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587084.340170:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788587084.340262:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309921024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587084.340690:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587084.340700:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309921152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587084.340736:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587084.340768:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309921152 00000100:00100000:1.0:1788587084.340773:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309921152 00000100:00100000:1.0:1788587084.340957:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587084.340965:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309921152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587084.340989:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587084.341026:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309921152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587084.341032:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788587084.341048:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587084.341073:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e0a300 x1875469309921152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587084.341087:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309921152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587084.341265:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309921280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587084.341296:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587084.341385:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309921280 00000100:00100000:0.0:1788587084.341390:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309921280 00000100:00100000:0.0:1788587084.341429:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788587084.341436:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309921280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587084.341448:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587084.341483:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309921280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587084.341489:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788587084.341515:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fde300 x1875469309921280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587084.341530:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309921280:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788587084.341574:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587084.846137:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309921408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587084.846208:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587084.846341:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309921408 00000100:00100000:2.0:1788587084.846348:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309921408 00000100:00100000:2.0:1788587084.846398:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788587084.846407:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309921408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587084.846445:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587084.849599:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309921408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3182us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587084.849615:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788587084.850343:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309921408:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587085.227657:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587086.250987:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587086.993889:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587086.994058:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587086.994103:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587086.994158:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292022272 00000100:00100000:0.0:1788587086.994168:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292022272 00000100:00100000:0.0:1788587086.994230:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 287 00000100:00100000:0.0:1788587086.994240:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2410:x1875469292022272:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587086.994307:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2410:x1875469292022272:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587086.994315:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 287 00000100:00100000:2.0:1788587087.003877:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292022400 00000100:00100000:2.0:1788587087.003895:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292022400 00000100:00080000:0.0:1788587087.004005:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587087.007824:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292022528 00000100:00100000:2.0:1788587087.007839:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292022528 00000100:00080000:3.0:1788587087.007986:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587087.016547:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:2.0:1788587087.016575:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292022400:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587087.016674:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292022400:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 113us (22795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.016682:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:2.0:1788587087.016714:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:2.0:1788587087.016723:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292022528:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587087.016753:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292022528:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 32us (22650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.016760:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 118 00010000:00010000:3.0:1788587087.275275:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587087.916651:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309921664:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.916734:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.916840:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309922176:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.916862:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.916883:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309922688:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.916902:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.916929:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788587087.916935:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309921536:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.916961:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.916979:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309922048:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.917026:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.918318:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309922560:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.918376:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.918412:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309923072:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.918432:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.918469:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309921792:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.918492:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.918512:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309922304:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.918534:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.918551:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309922816:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.918568:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.918586:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788587087.918592:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309921920:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.918610:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.918622:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309922432:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.918637:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587087.918663:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309922944:0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.918681:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587087.918839:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309921664 00000100:00100000:0.0:1788587087.918848:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309921664 00000100:00100000:0.0:1788587087.918886:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309922176 00000100:00100000:0.0:1788587087.918889:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309922176 00000100:00100000:0.0:1788587087.918913:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309922688 00000100:00100000:0.0:1788587087.918916:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309922688 00000100:00100000:0.0:1788587087.918931:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309922304 00000100:00100000:0.0:1788587087.918933:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309922304 00000100:00100000:0.0:1788587087.918945:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309922816 00000100:00100000:0.0:1788587087.918948:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309922816 00000100:00100000:0.0:1788587087.918958:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309921920 00000100:00100000:0.0:1788587087.918961:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309921920 00000100:00100000:0.0:1788587087.918974:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788587087.918982:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309921664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587087.920845:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309921664:12345-0@lo:400:kworker.0 Request processed in 1858us (4106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587087.920858:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788587087.920894:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788587087.920905:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309922176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587087.920948:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309922176:12345-0@lo:400:kworker.0 Request processed in 48us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587087.920955:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788587087.920977:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788587087.920983:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309922688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587087.921860:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309922048 00000100:00100000:3.0:1788587087.921869:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309922048 00000100:00100000:3.0:1788587087.921902:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309921792 00000100:00100000:3.0:1788587087.921905:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309921792 00000100:00100000:3.0:1788587087.921918:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788587087.921924:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309922048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.923249:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309922560 00000100:00100000:2.0:1788587087.923260:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309922560 00000100:00100000:2.0:1788587087.923298:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309923072 00000100:00100000:2.0:1788587087.923301:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309923072 00000100:00100000:2.0:1788587087.923313:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309922432 00000100:00100000:2.0:1788587087.923316:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309922432 00000100:00100000:2.0:1788587087.923330:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309922944 00000100:00100000:2.0:1788587087.923333:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309922944 00000100:00100000:2.0:1788587087.923347:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587087.923355:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309922560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.923419:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309922560:12345-0@lo:400:kworker.0 Request processed in 64us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.923426:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587087.923442:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788587087.923448:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309923072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.923476:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309923072:12345-0@lo:400:kworker.0 Request processed in 29us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.923482:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788587087.923495:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788587087.923501:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309922432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.923549:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309922432:12345-0@lo:400:kworker.0 Request processed in 48us (4910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.923555:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788587087.923565:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587087.923570:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309922944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.923619:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309922944:12345-0@lo:400:kworker.0 Request processed in 49us (4936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.923624:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587087.923655:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788587087.923663:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309922304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.923837:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309922304:12345-0@lo:400:kworker.0 Request processed in 175us (5301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.923844:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788587087.923859:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788587087.923865:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309922816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.923898:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309922816:12345-0@lo:400:kworker.0 Request processed in 33us (5328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.923903:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788587087.923914:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788587087.923921:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309921920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587087.923946:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309921920:12345-0@lo:400:kworker.0 Request processed in 27us (5335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587087.923950:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788587087.924768:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309921920:0@lo:400:kworker.0 00010000:00080000:1.0:1788587087.924822:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3418b100 x1875469309922432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587087.924833:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309922432:0@lo:400:kworker.0 00010000:00080000:1.0:1788587087.924843:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3418aa00 x1875469309922944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587087.924851:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309922944:0@lo:400:kworker.0 00010000:00080000:1.0:1788587087.924862:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34189c00 x1875469309922304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587087.924869:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309922304:0@lo:400:kworker.0 00010000:00080000:1.0:1788587087.924879:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34188e00 x1875469309922816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587087.924887:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309922816:0@lo:400:kworker.0 00000100:00100000:0.0:1788587087.925318:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309922688:12345-0@lo:400:kworker.0 Request processed in 4331us (8411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587087.925327:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788587087.925358:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587087.925364:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587087.925367:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587087.925370:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788587087.925407:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3418b480 x1875469309922560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587087.925417:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309922560:0@lo:400:kworker.0 00010000:00080000:0.0:1788587087.925429:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3418bb80 x1875469309923072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587087.925436:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309923072:0@lo:400:kworker.0 00000100:00100000:0.0:1788587087.925448:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309921664:0@lo:400:kworker.0 00000100:00100000:0.0:1788587087.925459:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309922176:0@lo:400:kworker.0 00000100:00100000:0.0:1788587087.925467:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309922688:0@lo:400:kworker.0 00000100:00100000:3.0:1788587087.930928:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309922048:12345-0@lo:400:kworker.0 Request processed in 8993us (13891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587087.930943:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788587087.930977:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788587087.930989:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309921792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587087.931136:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309921792:12345-0@lo:400:kworker.0 Request processed in 152us (12642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587087.931143:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788587087.931168:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309921536 00000100:00100000:3.0:1788587087.931176:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309921536 00000100:00100000:3.0:1788587087.931213:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788587087.931220:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309921536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587087.931251:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309921536:12345-0@lo:400:kworker.0 Request processed in 32us (14290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587087.931257:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788587087.931381:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309921792:0@lo:400:kworker.0 00000100:00100000:0.0:1788587087.935140:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309922048:0@lo:400:kworker.0 00000100:00100000:0.0:1788587087.935176:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309921536:0@lo:400:kworker.0 00000001:02000400:1.0:1788587088.240220:0:11561:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:44:46 (1788587086) === 00010000:00010000:0.0:1788587088.300117:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587088.428096:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587088.428120:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309923200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587088.428189:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587088.428254:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309923200 00000100:00100000:1.0:1788587088.428262:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309923200 00000100:00100000:1.0:1788587088.428307:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587088.428316:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309923200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587088.428351:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587088.428394:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309923200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.428415:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788587088.428456:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e09500 x1875469309923200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587088.428473:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309923200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587088.428686:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587088.428696:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309923328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587088.428743:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587088.429069:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309923328 00000100:00100000:1.0:1788587088.429074:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309923328 00000100:00100000:1.0:1788587088.429100:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587088.429107:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309923328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587088.429119:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587088.429152:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309923328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.429158:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788587088.429458:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fddc00 x1875469309923328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587088.429475:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309923328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587088.645338:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587088.645431:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292022656 00000100:00100000:1.0:1788587088.645441:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292022656 00000100:00100000:1.0:1788587088.645489:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 289 00000100:00100000:1.0:1788587088.645498:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:8975:x1875469292022656:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788587088.645513:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587088.645528:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634392d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5726 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587088.645554:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634392d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5726 expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587088.645582:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634392d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5726 expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587088.645591:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc200, rc 0) 00000100:00100000:1.0:1788587088.645642:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8975:x1875469292022656:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 145us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.645649:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 289 00000100:00100000:1.0:1788587088.657629:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587088.657841:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292022784 00000100:00100000:0.0:1788587088.657859:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292022784 00000100:00100000:0.0:1788587088.657903:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 290 00000100:00100000:0.0:1788587088.657914:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8975:x1875469292022784:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587088.658200:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8975:x1875469292022784:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 288us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.658208:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 290 00000100:00100000:0.0:1788587088.663066:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587088.663300:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292022912 00000100:00100000:3.0:1788587088.663310:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292022912 00000100:00100000:3.0:1788587088.663377:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 291 00000100:00100000:3.0:1788587088.663396:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8975:x1875469292022912:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788587088.663665:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8975:x1875469292022912:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 278us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.663673:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 291 00000100:00100000:3.0:1788587088.669509:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587088.669928:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292023040 00000100:00100000:1.0:1788587088.669939:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292023040 00000100:00100000:1.0:1788587088.670084:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 292 00000100:00100000:1.0:1788587088.670095:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8979:x1875469292023040:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587088.670453:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8979:x1875469292023040:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 351us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.670462:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 292 00000100:00100000:2.0:1788587088.708969:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587088.709247:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292023168 00000100:00100000:0.0:1788587088.709258:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292023168 00000100:00100000:0.0:1788587088.709317:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 293 00000100:00100000:0.0:1788587088.709327:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8979:x1875469292023168:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587088.709587:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8979:x1875469292023168:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 261us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.709595:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 293 00000100:00100000:0.0:1788587088.715098:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587088.716583:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292023296 00000100:00100000:1.0:1788587088.716596:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292023296 00000100:00100000:1.0:1788587088.716663:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 294 00000100:00100000:1.0:1788587088.716674:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8979:x1875469292023296:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587088.722110:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8979:x1875469292023296:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 5427us (7010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587088.722123:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 294 00000100:00100000:1.0:1788587088.724043:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587088.724121:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292023424 00000100:00100000:3.0:1788587088.724129:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292023424 00000100:00100000:3.0:1788587088.724172:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 295 00000100:00100000:3.0:1788587088.724182:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:8975:x1875469292023424:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788587088.724198:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587088.724214:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37105600/0x419e1ae1f6343934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5757 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587088.724239:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37105600/0x419e1ae1f6343934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5757 expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587088.724247:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37105600/0x419e1ae1f6343934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5757 expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587088.724254:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105600, rc 0) 00000100:00100000:3.0:1788587088.724293:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:8975:x1875469292023424:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 112us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.724300:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 295 00000100:00100000:3.0:1788587088.727026:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587088.728389:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292023552 00000100:00100000:2.0:1788587088.728402:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292023552 00000100:00100000:2.0:1788587088.728469:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 296 00000100:00100000:2.0:1788587088.728490:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:8975:x1875469292023552:12345-192.168.203.14@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788587088.728514:0:6467:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788587088.728529:0:6467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788587088.728533:0:6467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788587088.728536:0:6467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788587088.728540:0:6467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788587088.728542:0:6467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788587088.730570:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:8975:x1875469292023552:12345-192.168.203.14@tcp:256:mount.lustre.0 Request processed in 2073us (3625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587088.730584:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 296 00000100:00100000:1.0:1788587088.733163:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587088.733476:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292023680 00000100:00100000:3.0:1788587088.733486:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292023680 00000100:00100000:3.0:1788587088.733550:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 297 00000100:00100000:3.0:1788587088.733560:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:8975:x1875469292023680:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788587088.733575:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587088.733591:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd575e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587088.733618:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587088.733630:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587088.733638:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105a00, rc 0) 00000100:00100000:3.0:1788587088.733747:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8975:x1875469292023680:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 188us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.733755:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 297 00000100:00100000:3.0:1788587088.736323:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587088.736432:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292023808 00000100:00100000:2.0:1788587088.736440:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292023808 00000100:00100000:2.0:1788587088.736522:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 298 00000100:00100000:2.0:1788587088.736532:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8975:x1875469292023808:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587088.737113:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8975:x1875469292023808:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 579us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587088.737122:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 298 00000100:00100000:1.0:1788587088.739484:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587088.739575:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292023936 00000100:00100000:0.0:1788587088.739584:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292023936 00000100:00100000:0.0:1788587088.739670:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 299 00000100:00100000:0.0:1788587088.739680:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8975:x1875469292023936:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788587088.740417:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8975:x1875469292023936:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 736us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.740426:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 299 00000100:00100000:1.0:1788587088.742937:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587088.743033:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292024064 00000100:00100000:2.0:1788587088.743041:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292024064 00000100:00100000:2.0:1788587088.743094:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 300 00000100:00100000:2.0:1788587088.743104:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8984:x1875469292024064:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587088.743330:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8984:x1875469292024064:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 226us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587088.743339:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 300 00000100:00100000:1.0:1788587088.746501:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587088.748870:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292024192 00000100:00100000:0.0:1788587088.748899:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292024192 00000100:00100000:0.0:1788587088.748964:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 301 00000100:00100000:0.0:1788587088.748974:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8984:x1875469292024192:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587088.749224:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:8984:x1875469292024192:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 250us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.749233:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 301 00000100:00100000:1.0:1788587088.761961:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587088.762023:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587088.762051:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587088.762081:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587088.762162:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292024320 00000100:00100000:3.0:1788587088.762172:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292024320 00000100:00100000:3.0:1788587088.762201:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292024576 00000100:00100000:3.0:1788587088.762204:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292024576 00000100:00100000:3.0:1788587088.762211:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292025088 00000100:00100000:3.0:1788587088.762213:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292025088 00000100:00100000:3.0:1788587088.762233:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292024960 00000100:00100000:3.0:1788587088.762235:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292024960 00000100:00100000:3.0:1788587088.762252:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:3.0:1788587088.762261:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292025088:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587088.762333:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292025088:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.762349:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:3.0:1788587088.762367:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:3.0:1788587088.762374:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292024960:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587088.762402:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292024960:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.762408:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:3.0:1788587088.762421:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788587088.762425:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875469292024320:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788587088.762448:0:6472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7bb361c2-21de-4228-8a96-92f24b49adc6@192.168.203.14@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1788587088.762482:0:6472:0:(genops.c:1385:class_connect()) connect: client 7bb361c2-21de-4228-8a96-92f24b49adc6, cookie 0x419e1ae1f6343942 00000004:00100000:3.0:1788587088.762511:0:6472:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788587088.762857:0:6472:0:(import.c:65:import_set_state_nolock()) ffff8cbe04fd6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587088.762887:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2408:x1875469292024320:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 459us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.762894:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788587088.762908:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788587088.762913:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875469292024576:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788587088.762926:0:6472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7bb361c2-21de-4228-8a96-92f24b49adc6@192.168.203.14@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1788587088.762946:0:6472:0:(genops.c:1385:class_connect()) connect: client 7bb361c2-21de-4228-8a96-92f24b49adc6, cookie 0x419e1ae1f6343949 00000004:00100000:3.0:1788587088.762961:0:6472:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788587088.763104:0:6472:0:(import.c:65:import_set_state_nolock()) ffff8cbe04fd7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587088.763129:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2408:x1875469292024576:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 214us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.763146:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:1.0:1788587088.770171:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587088.771107:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292024832 00000100:00100000:3.0:1788587088.771117:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292024832 00000100:00100000:3.0:1788587088.771201:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788587088.771210:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:8975:x1875469292024832:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587088.771252:0:6472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788587088.771434:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587088.776034:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:8975:x1875469292024832:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 4804us (5852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.776050:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788587088.782269:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587088.782455:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587088.788251:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292024448 00000100:00100000:3.0:1788587088.788267:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292024448 00000100:00100000:3.0:1788587088.788374:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292024704 00000100:00100000:3.0:1788587088.788378:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292024704 00000100:00100000:2.0:1788587088.788506:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587088.788696:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292025216 00000100:00100000:0.0:1788587088.788702:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292025216 00000100:00100000:0.0:1788587088.788744:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:0.0:1788587088.788755:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+7:0:x1875469292024448:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788587088.788815:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587088.788898:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+7:0:x1875469292024448:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 145us (6637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.788906:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:0.0:1788587088.788924:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:0.0:1788587088.788931:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:0:x1875469292024704:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788587088.788956:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587088.789000:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:0:x1875469292024704:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 69us (6545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.789006:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:0.0:1788587088.789035:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:0.0:1788587088.789042:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:8975:x1875469292025216:12345-192.168.203.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788587088.789071:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:8975:x1875469292025216:12345-192.168.203.14@tcp:40:mount.lustre.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.789094:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00080000:0.0:1788587088.789113:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587088.792375:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587088.792477:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292025600 00000100:00100000:1.0:1788587088.792486:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292025600 00000100:00100000:0.0:1788587088.792632:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:0.0:1788587088.792643:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:8975:x1875469292025600:12345-192.168.203.14@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788587088.793316:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:8975:x1875469292025600:12345-192.168.203.14@tcp:900:mount.lustre.0 Request processed in 672us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.793326:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:0.0:1788587088.798326:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587088.798366:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587088.798574:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292025344 00000100:00100000:2.0:1788587088.798584:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292025344 00000100:00100000:2.0:1788587088.798623:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292025472 00000100:00100000:2.0:1788587088.798626:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292025472 00000100:00100000:3.0:1788587088.798634:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:3.0:1788587088.798643:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2408:x1875469292025344:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788587088.798685:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7bb361c2-21de-4228-8a96-92f24b49adc6@192.168.203.14@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1788587088.798718:0:8449:0:(genops.c:1385:class_connect()) connect: client 7bb361c2-21de-4228-8a96-92f24b49adc6, cookie 0x419e1ae1f6343950 00002000:00100000:3.0:1788587088.798730:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7bb361c2-21de-4228-8a96-92f24b49adc6/ffff8cbe04fd2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587088.798752:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587088.799046:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587088.799076:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8cbe04fd7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587088.799135:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2408:x1875469292025344:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 491us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.802607:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587088.802734:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292025728 00000100:00100000:0.0:1788587088.802743:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292025728 00000100:00100000:0.0:1788587088.802829:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:0.0:1788587088.802840:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:8975:x1875469292025728:12345-192.168.203.14@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788587088.802921:0:6475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788587088.803006:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:8975:x1875469292025728:12345-192.168.203.14@tcp:33:mount.lustre.0 Request processed in 168us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587088.803013:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:2.0:1788587088.804638:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:2.0:1788587088.804649:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1875469292025472:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788587088.804696:0:8099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7bb361c2-21de-4228-8a96-92f24b49adc6@192.168.203.14@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:2.0:1788587088.804948:0:8099:0:(genops.c:1385:class_connect()) connect: client 7bb361c2-21de-4228-8a96-92f24b49adc6, cookie 0x419e1ae1f6343957 00002000:00100000:2.0:1788587088.804962:0:8099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7bb361c2-21de-4228-8a96-92f24b49adc6/ffff8cbf05221800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587088.804973:0:8099:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587088.805227:0:8099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788587088.805258:0:8099:0:(import.c:65:import_set_state_nolock()) ffff8cbf05223000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587088.805314:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2408:x1875469292025472:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 665us (6946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587088.805323:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:3.0:1788587088.807910:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00010000:00010000:0.0:1788587089.323021:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587089.451019:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309923456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587089.451094:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587089.451175:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309923456 00000100:00100000:1.0:1788587089.451182:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309923456 00000100:00100000:1.0:1788587089.451249:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788587089.451260:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309923456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587089.451282:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587089.451323:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309923456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587089.451330:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788587089.451373:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34188000 x1875469309923456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587089.451390:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309923456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587089.451736:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587089.451747:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309923584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587089.451813:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788587089.451936:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587089.452131:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309923584 00000100:00100000:3.0:1788587089.452150:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309923584 00000100:00100000:3.0:1788587089.452190:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788587089.452197:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309923584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587089.452239:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587089.452274:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309923584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587089.452280:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788587089.452785:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf341baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309923712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587089.452846:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587089.452897:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309923584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587089.452967:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309923712 00000100:00100000:2.0:1788587089.452981:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309923712 00000100:00100000:2.0:1788587089.453028:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587089.453036:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309923712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587089.453051:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587089.453085:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309923712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587089.453104:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788587089.453386:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788587089.453417:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf341baa00 x1875469309923712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587089.453437:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf341baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309923712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587089.968407:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309923840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587089.968475:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587089.968546:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309923840 00000100:00100000:1.0:1788587089.968553:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309923840 00000100:00100000:1.0:1788587089.968597:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587089.968606:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309923840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587089.968659:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587089.968707:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309923840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587089.968715:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587089.968771:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309923840:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788587090.070504:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bb361c2-21de-4228-8a96-92f24b49adc6 00010000:00010000:3.0:1788587090.347211:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587091.371098:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587091.651079:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bb361c2-21de-4228-8a96-92f24b49adc6 00010000:00010000:0.0:1788587092.397014:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587093.035199:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309923968:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035270:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.035323:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309924480:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035351:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.035382:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309924992:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035406:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.035424:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309925504:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035443:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.035468:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788587093.035474:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309924352:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035495:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.035510:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309924864:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035528:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.035545:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309925376:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035582:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.035615:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309924480 00000100:00100000:2.0:1788587093.035623:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309924480 00000100:00100000:2.0:1788587093.035668:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788587093.035676:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309924480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035726:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309924480:12345-0@lo:400:kworker.0 Request processed in 51us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.035733:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788587093.035766:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309924992 00000100:00100000:2.0:1788587093.035775:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309924992 00000100:00100000:2.0:1788587093.035824:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309925504 00000100:00100000:2.0:1788587093.035827:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309925504 00000100:00100000:2.0:1788587093.035840:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309924864 00000100:00100000:2.0:1788587093.035842:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309924864 00000100:00100000:2.0:1788587093.035854:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309925376 00000100:00100000:2.0:1788587093.035856:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309925376 00000100:00100000:2.0:1788587093.035867:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788587093.035873:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309924992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035903:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309924992:12345-0@lo:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.035915:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788587093.035927:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788587093.035933:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309925504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.035948:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309924096:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.035959:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309925504:12345-0@lo:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.035964:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788587093.035975:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587093.035975:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.035980:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309924864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.035993:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309924608:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.036004:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309924864:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.036009:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587093.036012:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.036020:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587093.036025:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309925376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036025:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309925120:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036044:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.036047:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309925376:12345-0@lo:400:kworker.0 Request processed in 22us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.036052:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788587093.036067:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788587093.036072:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309924224:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036093:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788587093.036101:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34189c00 x1875469309924864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587093.036107:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309924736:0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.036114:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309924864:0@lo:400:kworker.0 00010000:00080000:2.0:1788587093.036124:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bace680 x1875469309925376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587093.036133:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309925376:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036135:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587093.036142:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309924480:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036144:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309925248:0@lo:400:kworker.0 00010000:00080000:2.0:1788587093.036151:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3418aa00 x1875469309924992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587093.036159:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309924992:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036160:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788587093.036168:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06894380 x1875469309925504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587093.036175:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309925504:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036180:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309924352 00000100:00100000:0.0:1788587093.036183:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309924352 00000100:00100000:0.0:1788587093.036202:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309924096 00000100:00100000:0.0:1788587093.036204:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309924096 00000100:00100000:2.0:1788587093.036209:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309924224 00000100:00100000:2.0:1788587093.036212:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309924224 00000100:00100000:0.0:1788587093.036215:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309924608 00000100:00100000:0.0:1788587093.036217:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309924608 00000100:00100000:2.0:1788587093.036229:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788587093.036234:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309925120 00000100:00100000:2.0:1788587093.036235:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309924224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036237:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309925120 00000100:00100000:0.0:1788587093.036246:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309924736 00000100:00100000:0.0:1788587093.036248:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309924736 00000100:00100000:2.0:1788587093.036268:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309924224:12345-0@lo:400:kworker.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587093.036269:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309925248 00000100:00100000:0.0:1788587093.036272:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309925248 00000100:00100000:2.0:1788587093.036273:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788587093.036284:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788587093.036289:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309924352:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788587093.036306:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587093.036309:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587093.036311:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587093.036314:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587093.036321:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309924352:12345-0@lo:400:kworker.0 Request processed in 32us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587093.036327:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788587093.036337:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788587093.036339:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309924352:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036343:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309924096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.036368:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309924096:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587093.036374:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788587093.036434:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788587093.036443:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309924608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.036474:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309924608:12345-0@lo:400:kworker.0 Request processed in 33us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.036480:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788587093.036491:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788587093.036497:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309925120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.036520:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309925120:12345-0@lo:400:kworker.0 Request processed in 24us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.036526:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788587093.036535:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788587093.036540:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309924736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.036565:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309924736:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.036571:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788587093.036581:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788587093.036587:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309925248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587093.036610:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309925248:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587093.036616:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788587093.036842:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309923968 00000100:00100000:1.0:1788587093.036848:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309923968 00000100:00100000:1.0:1788587093.036884:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788587093.036891:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309923968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587093.036933:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309923968:12345-0@lo:400:kworker.0 Request processed in 42us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587093.036939:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788587093.036955:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309924224:0@lo:400:kworker.0 00010000:00080000:0.0:1788587093.036966:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34188e00 x1875469309924736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587093.036975:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309924736:0@lo:400:kworker.0 00000100:00100000:1.0:1788587093.036980:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309923968:0@lo:400:kworker.0 00010000:00080000:0.0:1788587093.036984:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3418ad80 x1875469309925248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587093.036992:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309925248:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.037001:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309924096:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.037009:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309924608:0@lo:400:kworker.0 00000100:00100000:0.0:1788587093.037018:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309925120:0@lo:400:kworker.0 00010000:00010000:0.0:1788587093.419188:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587093.547501:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309925760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587093.547570:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587093.547624:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587093.547631:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309925632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587093.547654:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587093.547879:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309925760 00000100:00100000:1.0:1788587093.547888:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309925760 00000100:00100000:1.0:1788587093.547926:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309925632 00000100:00100000:1.0:1788587093.547929:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309925632 00000100:00100000:1.0:1788587093.547944:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788587093.547951:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309925760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587093.547992:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587093.548038:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309925760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587093.548045:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788587093.548062:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788587093.548067:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309925632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587093.548076:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587093.548098:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309925632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587093.548103:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788587093.548171:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06895500 x1875469309925632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587093.548189:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309925632:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788587093.548199:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06897480 x1875469309925760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587093.548209:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309925760:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788587093.593295:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7bb361c2-21de-4228-8a96-92f24b49adc6 00000001:00100000:0.0:1788587093.613379:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7bb361c2-21de-4228-8a96-92f24b49adc6 00000100:00100000:3.0:1788587094.164263:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587094.164314:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587094.164349:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587094.164377:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587094.164392:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587094.164406:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587094.164423:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587094.164449:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292026496 00000100:00100000:3.0:1788587094.164458:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292026496 00000100:00100000:3.0:1788587094.164509:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292026624 00000100:00100000:3.0:1788587094.164511:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292026624 00000100:00100000:3.0:1788587094.164534:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:3.0:1788587094.164543:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292026496:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587094.164551:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292025984 00000100:00100000:0.0:1788587094.164568:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292025984 00000100:00100000:0.0:1788587094.164599:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292026240 00000100:00100000:0.0:1788587094.164603:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292026240 00000100:00100000:0.0:1788587094.164619:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292026112 00000100:00100000:0.0:1788587094.164623:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292026112 00000100:00100000:0.0:1788587094.164635:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292026368 00000100:00100000:0.0:1788587094.164637:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292026368 00000100:00100000:0.0:1788587094.164651:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:0.0:1788587094.164658:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292025984:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587094.164697:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292025984:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 40us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587094.164705:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:0.0:1788587094.164722:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:0.0:1788587094.164728:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292026240:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587094.164782:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292026240:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 54us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587094.164788:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:0.0:1788587094.164833:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:0.0:1788587094.164839:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292026112:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587094.164863:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292026112:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587094.164868:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:0.0:1788587094.164879:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:0.0:1788587094.164884:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292026368:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587094.164925:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292026368:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587094.164944:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:0.0:1788587094.164997:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:0.0:1788587094.165005:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292026624:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587094.165031:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292026624:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587094.165037:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00080000:0.0:1788587094.165070:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587094.165074:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587094.165077:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587094.165078:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587094.165256:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292026496:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 713us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587094.165264:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:2.0:1788587094.166195:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292025856 00000100:00100000:2.0:1788587094.166205:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292025856 00000100:00100000:2.0:1788587094.166262:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 303 00000100:00100000:2.0:1788587094.166271:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292025856:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587094.166407:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292025856:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 136us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587094.166415:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 303 00000001:02000400:3.0:1788587094.333560:0:11762:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788587094.446132:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587094.571265:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309926016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587094.571302:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309925888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587094.572742:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587094.573099:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587094.573111:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309926144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587094.573147:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587094.574327:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309925888 00000100:00100000:2.0:1788587094.574339:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309925888 00000100:00100000:2.0:1788587094.574460:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309926144 00000100:00100000:2.0:1788587094.574463:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309926144 00000100:00100000:2.0:1788587094.574481:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788587094.574865:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309925888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587094.575048:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587094.575247:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309925888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 757us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587094.575255:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788587094.575276:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587094.575284:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309926144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587094.575294:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587094.575320:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309926144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587094.575325:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788587094.575368:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0d180 x1875469309925888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587094.575469:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309925888:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788587094.576538:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06895500 x1875469309926144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587094.576575:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309926144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587094.578165:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587094.579285:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309926016 00000100:00100000:2.0:1788587094.579297:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309926016 00000100:00100000:2.0:1788587094.579360:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788587094.579371:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309926016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587094.579438:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587094.579518:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309926016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587094.579525:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788587094.579770:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309926016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587095.085638:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587095.085664:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309926272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587095.085758:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587095.085965:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309926272 00000100:00100000:2.0:1788587095.085974:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309926272 00000100:00100000:2.0:1788587095.086025:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788587095.086035:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309926272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587095.086075:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587095.086138:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309926272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587095.086146:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788587095.086314:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309926272:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788587095.467884:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587096.491093:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587097.515326:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587098.165286:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309926528:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165352:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165400:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309927040:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165419:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165442:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309927552:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165461:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165484:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788587098.165489:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309926400:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165514:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165532:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309926912:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165554:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165581:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309927424:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165617:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165634:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309927936:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165653:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165677:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309926656:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165701:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165728:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309927168:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165749:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165764:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309927680:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165784:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165825:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788587098.165831:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309926784:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165853:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165864:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309927296:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.165883:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.165901:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309927808:0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166065:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309926912 00000100:00100000:3.0:1788587098.166074:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309926912 00000100:00100000:3.0:1788587098.166106:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309926656 00000100:00100000:3.0:1788587098.166109:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309926656 00000100:00100000:3.0:1788587098.166124:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788587098.166133:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309926912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166191:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309926912:12345-0@lo:400:kworker.0 Request processed in 58us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166198:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788587098.166213:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788587098.166218:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf2c3f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309926656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166243:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf2c3f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309926656:12345-0@lo:400:kworker.0 Request processed in 25us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166248:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788587098.166508:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309926400 00000100:00100000:3.0:1788587098.166512:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309926400 00000100:00100000:3.0:1788587098.166535:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788587098.166541:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309926400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166572:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309926400:12345-0@lo:400:kworker.0 Request processed in 31us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166578:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788587098.166600:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309926528 00000100:00100000:3.0:1788587098.166603:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309926528 00000100:00100000:3.0:1788587098.166628:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309927040 00000100:00100000:3.0:1788587098.166631:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309927040 00000100:00100000:3.0:1788587098.166648:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309927552 00000100:00100000:3.0:1788587098.166650:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309927552 00000100:00100000:3.0:1788587098.166660:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309927168 00000100:00100000:3.0:1788587098.166662:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309927168 00000100:00100000:3.0:1788587098.166672:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309927680 00000100:00100000:3.0:1788587098.166674:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309927680 00000100:00100000:3.0:1788587098.166683:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309926784 00000100:00100000:3.0:1788587098.166685:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309926784 00000100:00100000:3.0:1788587098.166695:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788587098.166700:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309926528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166739:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309926528:12345-0@lo:400:kworker.0 Request processed in 39us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166746:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788587098.166756:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788587098.166763:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309927040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166786:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309927040:12345-0@lo:400:kworker.0 Request processed in 24us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166791:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788587098.166822:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788587098.166827:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309927552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166849:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309927552:12345-0@lo:400:kworker.0 Request processed in 22us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166854:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788587098.166863:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788587098.166867:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309927168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166886:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309927168:12345-0@lo:400:kworker.0 Request processed in 19us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166897:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788587098.166906:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788587098.166911:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309927680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166946:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309927680:12345-0@lo:400:kworker.0 Request processed in 35us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166951:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788587098.166960:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788587098.166965:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309926784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.166984:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309926784:12345-0@lo:400:kworker.0 Request processed in 20us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.166989:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1788587098.167013:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587098.167017:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587098.167043:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309927424 00000100:00100000:3.0:1788587098.167046:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309927424 00000100:00100000:3.0:1788587098.167068:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309927936 00000100:00100000:3.0:1788587098.167070:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309927936 00000100:00100000:3.0:1788587098.167079:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309927296 00000100:00100000:3.0:1788587098.167081:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309927296 00000100:00100000:3.0:1788587098.167093:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788587098.167098:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309927424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.167123:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309927424:12345-0@lo:400:kworker.0 Request processed in 26us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.167129:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788587098.167137:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788587098.167142:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309927936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.167172:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309927936:12345-0@lo:400:kworker.0 Request processed in 30us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.167177:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788587098.167186:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788587098.167191:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309927296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.167210:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309927296:12345-0@lo:400:kworker.0 Request processed in 20us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.167216:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788587098.167231:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587098.167233:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587098.167268:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309926400:0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.167280:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309926912:0@lo:400:kworker.0 00010000:00080000:3.0:1788587098.167292:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0fb80 x1875469309927424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587098.167303:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309927424:0@lo:400:kworker.0 00010000:00080000:3.0:1788587098.167312:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0d500 x1875469309927936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587098.167320:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309927936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.167330:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309926528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.167339:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309927040:0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.167347:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309927552:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.168690:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587098.168757:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309926656:0@lo:400:kworker.0 00010000:00080000:2.0:1788587098.168773:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0ce00 x1875469309927168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587098.168784:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309927168:0@lo:400:kworker.0 00010000:00080000:2.0:1788587098.168906:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0e680 x1875469309927680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587098.168916:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309927680:0@lo:400:kworker.0 00000100:00100000:2.0:1788587098.169340:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309926784:0@lo:400:kworker.0 00010000:00080000:2.0:1788587098.169352:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0ea00 x1875469309927296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587098.169361:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309927296:0@lo:400:kworker.0 00000100:00100000:3.0:1788587098.169461:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309927808 00000100:00100000:3.0:1788587098.169471:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309927808 00000100:00100000:3.0:1788587098.169537:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788587098.169546:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309927808:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788587098.169716:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587098.169824:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309927808:12345-0@lo:400:kworker.0 Request processed in 279us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.169832:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788587098.170008:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0f800 x1875469309927808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587098.170019:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309927808:0@lo:400:kworker.0 00010000:00010000:0.0:1788587098.541228:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587098.668107:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309928192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587098.668177:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587098.668251:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309928192 00000100:00100000:1.0:1788587098.668259:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309928192 00000100:00100000:1.0:1788587098.668300:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587098.668309:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309928192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587098.668355:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587098.668402:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309928192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587098.668410:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788587098.669524:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06894000 x1875469309928192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587098.669550:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309928192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587098.671866:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587098.671893:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309928064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587098.673228:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587098.675575:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309928064 00000100:00100000:1.0:1788587098.675600:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309928064 00000100:00100000:1.0:1788587098.675656:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587098.675666:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309928064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587098.675693:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587098.675765:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309928064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587098.675785:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788587098.675850:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06895500 x1875469309928064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587098.675871:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309928064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587099.286879:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587099.286989:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587099.297851:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587099.297887:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587099.297909:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587099.299980:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292026880 00000100:00100000:3.0:1788587099.299996:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292026880 00000100:00100000:3.0:1788587099.300083:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292027136 00000100:00100000:3.0:1788587099.300087:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292027136 00000100:00100000:3.0:1788587099.300119:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 143 00000100:00100000:3.0:1788587099.300130:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292026880:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587099.300227:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292026880:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 98us (13359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.300235:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 143 00000100:00100000:3.0:1788587099.300252:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:3.0:1788587099.300259:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292027136:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587099.300284:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292027136:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (13301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.300291:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:3.0:1788587099.300317:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292027392 00000100:00100000:3.0:1788587099.300321:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292027392 00000100:00100000:3.0:1788587099.300351:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:3.0:1788587099.300357:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292027392:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587099.300382:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292027392:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 25us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.300398:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00080000:3.0:1788587099.300414:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587099.300418:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587099.301213:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292026752 00000100:00100000:3.0:1788587099.301284:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292026752 00000100:00100000:3.0:1788587099.301324:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 305 00000100:00100000:3.0:1788587099.301331:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292026752:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587099.302086:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292026752:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 750us (4193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.302097:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 305 00000100:00100000:0.0:1788587099.303376:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587099.303406:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587099.303442:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292027520 00000100:00100000:0.0:1788587099.303451:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292027520 00000100:00100000:3.0:1788587099.303826:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292027008 00000100:00100000:3.0:1788587099.303831:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292027008 00000100:00100000:3.0:1788587099.303875:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292027264 00000100:00100000:3.0:1788587099.303879:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292027264 00000100:00100000:3.0:1788587099.303898:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00100000:3.0:1788587099.303907:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292027008:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587099.304047:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:0.0:1788587099.304058:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292027520:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587099.304095:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292027520:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.304100:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:2.0:1788587099.304296:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:2.0:1788587099.304307:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292027264:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587099.304407:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292027264:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 103us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.304414:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00080000:2.0:1788587099.305038:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587099.305045:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587099.306326:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292027008:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 2413us (8407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.306336:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 145 00010000:00010000:1.0:1788587099.563984:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587099.691081:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587099.691108:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309928320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587099.691178:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.691371:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587099.691381:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309928448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587099.691409:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587099.691472:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309928448 00000100:00100000:1.0:1788587099.691480:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309928448 00000100:00100000:1.0:1788587099.691536:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587099.691546:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309928448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587099.691689:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587099.691760:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309928448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 215us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.691768:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788587099.691889:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc2300 x1875469309928448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587099.691974:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309928448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587099.692057:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309928320 00000100:00100000:3.0:1788587099.692062:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309928320 00000100:00100000:3.0:1788587099.692099:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788587099.692108:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309928320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587099.692137:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587099.692176:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309928320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.692195:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788587099.692275:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309928320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587099.695840:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309928576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587099.695927:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.696032:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309928576 00000100:00100000:3.0:1788587099.696042:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309928576 00000100:00100000:3.0:1788587099.696095:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788587099.696106:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309928576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587099.696129:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587099.699034:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309928576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2920us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.699049:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788587099.703041:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc2300 x1875469309928576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587099.703076:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309928576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587100.203141:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587100.203165:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309928704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587100.203245:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587100.203620:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309928704 00000100:00100000:3.0:1788587100.203629:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309928704 00000100:00100000:3.0:1788587100.203685:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587100.203703:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309928704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587100.203744:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587100.203814:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309928704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587100.203822:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587100.205216:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309928704:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587100.587208:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587101.612653:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587102.637851:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587103.275717:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309928832:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.275791:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587103.275860:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309929344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.275891:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587103.275909:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309929856:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.275930:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587103.275960:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309930368:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.275982:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587103.276008:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788587103.276014:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309929216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276038:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587103.276056:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309929728:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276074:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587103.276091:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309930240:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276110:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587103.276140:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309928832 00000100:00100000:3.0:1788587103.276147:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309928832 00000100:00100000:3.0:1788587103.276188:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788587103.276197:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309928832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276249:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309928832:12345-0@lo:400:kworker.0 Request processed in 53us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.276257:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788587103.276360:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309929344 00000100:00100000:3.0:1788587103.276364:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309929344 00000100:00100000:3.0:1788587103.276387:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788587103.276393:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309929344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276539:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309929344:12345-0@lo:400:kworker.0 Request processed in 144us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.276546:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788587103.276637:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309929856 00000100:00100000:3.0:1788587103.276642:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309929856 00000100:00100000:3.0:1788587103.276680:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309930368 00000100:00100000:3.0:1788587103.276683:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309930368 00000100:00100000:3.0:1788587103.276719:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309929728 00000100:00100000:3.0:1788587103.276722:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309929728 00000100:00100000:3.0:1788587103.276733:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309930240 00000100:00100000:3.0:1788587103.276736:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309930240 00000100:00100000:3.0:1788587103.276748:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587103.276754:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309929856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276786:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309929856:12345-0@lo:400:kworker.0 Request processed in 32us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.276814:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587103.276827:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587103.276832:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309930368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276861:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309930368:12345-0@lo:400:kworker.0 Request processed in 29us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.276867:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587103.276877:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788587103.276883:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309929728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276908:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309929728:12345-0@lo:400:kworker.0 Request processed in 26us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.276913:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788587103.276922:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788587103.276927:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309930240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.276949:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309930240:12345-0@lo:400:kworker.0 Request processed in 23us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.276954:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788587103.276973:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309929216 00000100:00100000:3.0:1788587103.276976:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309929216 00000100:00100000:3.0:1788587103.277000:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587103.277018:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309929216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.277049:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309929216:12345-0@lo:400:kworker.0 Request processed in 32us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.277054:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1788587103.277081:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587103.277085:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587103.277114:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309929216:0@lo:400:kworker.0 00010000:00080000:3.0:1788587103.277128:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9d180 x1875469309929728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587103.277138:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309929728:0@lo:400:kworker.0 00010000:00080000:3.0:1788587103.277147:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9dc00 x1875469309930240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587103.277155:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309930240:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.277163:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309928832:0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.277170:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309929344:0@lo:400:kworker.0 00010000:00080000:3.0:1788587103.277178:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9e300 x1875469309929856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587103.277185:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309929856:0@lo:400:kworker.0 00010000:00080000:3.0:1788587103.277194:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9ca80 x1875469309930368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587103.277201:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309930368:0@lo:400:kworker.0 00000100:00100000:1.0:1788587103.277386:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309929088:0@lo:400:kworker.0 00000100:00100000:1.0:1788587103.277531:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587103.277566:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309929600:0@lo:400:kworker.0 00000100:00100000:1.0:1788587103.277596:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587103.277618:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309930112:0@lo:400:kworker.0 00000100:00100000:1.0:1788587103.277635:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587103.277649:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788587103.277654:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309928960:0@lo:400:kworker.0 00000100:00100000:1.0:1788587103.277681:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587103.277694:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309929472:0@lo:400:kworker.0 00000100:00100000:1.0:1788587103.277710:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587103.277721:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309929984:0@lo:400:kworker.0 00000100:00100000:1.0:1788587103.277734:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587103.277967:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309929600 00000100:00100000:2.0:1788587103.277973:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309929600 00000100:00100000:2.0:1788587103.278012:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309930112 00000100:00100000:2.0:1788587103.278015:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309930112 00000100:00100000:2.0:1788587103.278026:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309928960 00000100:00100000:2.0:1788587103.278029:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309928960 00000100:00100000:2.0:1788587103.278038:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309929472 00000100:00100000:2.0:1788587103.278040:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309929472 00000100:00100000:2.0:1788587103.278050:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309929984 00000100:00100000:2.0:1788587103.278053:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309929984 00000100:00100000:2.0:1788587103.278065:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788587103.278080:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309929600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587103.278120:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309929600:12345-0@lo:400:kworker.0 Request processed in 42us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.278126:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788587103.278139:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788587103.278146:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309930112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587103.278172:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309930112:12345-0@lo:400:kworker.0 Request processed in 27us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.278177:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788587103.278187:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788587103.278193:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309928960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587103.278214:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309928960:12345-0@lo:400:kworker.0 Request processed in 22us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.278220:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788587103.278229:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788587103.278235:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309929472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587103.278260:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309929472:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.278326:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788587103.278338:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788587103.278344:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309929984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587103.278368:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309929984:12345-0@lo:400:kworker.0 Request processed in 25us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.278373:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788587103.278402:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309928960:0@lo:400:kworker.0 00000100:00100000:2.0:1788587103.278483:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309929472:0@lo:400:kworker.0 00000100:00100000:2.0:1788587103.278495:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309929984:0@lo:400:kworker.0 00010000:00080000:2.0:1788587103.278505:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9f800 x1875469309929600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587103.278514:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309929600:0@lo:400:kworker.0 00010000:00080000:2.0:1788587103.278522:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9df80 x1875469309930112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587103.278530:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309930112:0@lo:400:kworker.0 00000100:00080000:1.0:1788587103.278622:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587103.278627:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587103.279093:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309929088 00000100:00100000:3.0:1788587103.279106:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309929088 00000100:00100000:3.0:1788587103.279146:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788587103.279154:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309929088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587103.279197:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309929088:12345-0@lo:400:kworker.0 Request processed in 45us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.279204:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788587103.279230:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309929088:0@lo:400:kworker.0 00010000:00010000:2.0:1788587103.663577:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587103.790461:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587103.790540:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587103.790626:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309930496 00000100:00100000:2.0:1788587103.790634:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309930496 00000100:00100000:2.0:1788587103.790691:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788587103.790701:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309930496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587103.790739:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587103.790783:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309930496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.790790:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788587103.790851:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34189f80 x1875469309930496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587103.790871:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587103.794703:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309930624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587103.794783:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587103.803442:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309930624 00000100:00100000:2.0:1788587103.803455:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309930624 00000100:00100000:2.0:1788587103.803541:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788587103.803684:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309930624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587103.803709:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587103.803779:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309930624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (8995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.803786:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788587103.803943:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc2680 x1875469309930624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587103.803967:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309930624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587104.409810:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587104.409848:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587104.409867:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587104.409889:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587104.409907:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587104.409924:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587104.409945:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587104.410097:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292027776 00000100:00100000:3.0:1788587104.410106:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292027776 00000100:00100000:3.0:1788587104.410165:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292028032 00000100:00100000:3.0:1788587104.410168:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292028032 00000100:00100000:3.0:1788587104.410180:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292027904 00000100:00100000:3.0:1788587104.410183:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292027904 00000100:00100000:3.0:1788587104.410194:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292028160 00000100:00100000:3.0:1788587104.410196:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292028160 00000100:00100000:3.0:1788587104.410211:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 153 00000100:00100000:3.0:1788587104.410220:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292027776:12345-192.168.203.14@tcp:400:kworker.0 00000100:00080000:2.0:1788587104.410238:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587104.410242:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587104.410301:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292027776:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 82us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.410308:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 153 00000100:00100000:3.0:1788587104.410325:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 154 00000100:00100000:3.0:1788587104.410330:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292028032:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587104.410353:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292028032:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.410359:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 154 00000100:00100000:3.0:1788587104.410380:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00100000:3.0:1788587104.410386:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292027904:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587104.410434:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292027904:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 47us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.410440:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00100000:3.0:1788587104.410452:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 156 00000100:00100000:3.0:1788587104.410457:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292028160:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587104.410479:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292028160:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 22us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.410486:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 156 00000100:00100000:3.0:1788587104.410508:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292028288 00000100:00100000:3.0:1788587104.410512:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292028288 00000100:00100000:3.0:1788587104.410548:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292028416 00000100:00100000:3.0:1788587104.410550:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292028416 00000100:00100000:3.0:1788587104.410570:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:3.0:1788587104.410577:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292028288:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587104.410607:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292028288:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 30us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.410628:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:3.0:1788587104.410641:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00080000:2.0:1788587104.410644:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587104.410647:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292028416:12345-192.168.203.14@tcp:400:kworker.0 00000100:00080000:2.0:1788587104.410647:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587104.410682:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292028416:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 34us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.410687:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:3.0:1788587104.410705:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292027648 00000100:00100000:3.0:1788587104.410709:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292027648 00000100:00100000:3.0:1788587104.411015:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 307 00000100:00100000:3.0:1788587104.411030:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292027648:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587104.411058:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292027648:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 30us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.411064:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 307 00010000:00010000:3.0:1788587104.686675:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587104.811816:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309930752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587104.812003:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587104.812687:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309930752 00000100:00100000:2.0:1788587104.812697:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309930752 00000100:00100000:2.0:1788587104.812807:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788587104.812818:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3b8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309930752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587104.812864:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587104.813919:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3b8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309930752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1100us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587104.813929:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788587104.821431:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309930880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587104.821499:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587104.821601:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309931008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587104.821625:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587104.821880:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309930880 00000100:00100000:1.0:1788587104.821887:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309930880 00000100:00100000:1.0:1788587104.821927:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587104.821934:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309930880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587104.821955:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587104.821996:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309930880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587104.822003:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788587104.822458:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309931008 00000100:00100000:3.0:1788587104.822464:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309931008 00000100:00100000:3.0:1788587104.822498:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788587104.822504:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309931008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587104.822533:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587104.822629:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309931008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.822636:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788587104.822692:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309931008:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788587104.822790:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc2d80 x1875469309930880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587104.822823:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309930880:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788587104.823864:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9df80 x1875469309930752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587104.823896:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309930752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587105.323320:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587105.323342:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309931136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587105.323407:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587105.323485:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309931136 00000100:00100000:3.0:1788587105.323494:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309931136 00000100:00100000:3.0:1788587105.323537:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788587105.323545:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309931136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587105.323583:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587105.323645:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309931136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587105.323652:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788587105.323707:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309931136:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587105.709171:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587106.734352:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587107.755558:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587108.395441:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309931264:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.395489:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309931520:0@lo:400:kworker.0 00000100:00100000:3.0:1788587108.395567:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309931392:0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.395581:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309931648:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.401261:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587108.401338:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309932032:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.401388:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587108.401408:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309932544:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.401425:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587108.401476:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309931520 00000100:00100000:1.0:1788587108.401483:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309931520 00000100:00100000:1.0:1788587108.401533:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788587108.401554:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309931520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.401617:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309931520:12345-0@lo:400:kworker.0 Request processed in 75us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587108.401625:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788587108.401664:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309932032 00000100:00100000:1.0:1788587108.401667:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309932032 00000100:00100000:1.0:1788587108.401699:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309932544 00000100:00100000:1.0:1788587108.401702:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309932544 00000100:00100000:1.0:1788587108.401722:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788587108.401728:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309932032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.401767:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309932032:12345-0@lo:400:kworker.0 Request processed in 39us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587108.401773:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788587108.401784:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788587108.401790:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309932544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.401837:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309932544:12345-0@lo:400:kworker.0 Request processed in 48us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587108.401841:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788587108.401886:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309931520:0@lo:400:kworker.0 00010000:00080000:1.0:1788587108.401900:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacdc00 x1875469309932032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587108.401918:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309932032:0@lo:400:kworker.0 00010000:00080000:1.0:1788587108.401930:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacca80 x1875469309932544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587108.401938:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309932544:0@lo:400:kworker.0 00000100:00080000:1.0:1788587108.401992:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587108.401998:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587108.402024:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309931392 00000100:00100000:1.0:1788587108.402029:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309931392 00000100:00100000:3.0:1788587108.402031:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309931904:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.402061:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587108.402062:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587108.402072:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309931392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587108.402094:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309932416:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.402116:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309931392:12345-0@lo:400:kworker.0 Request processed in 45us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587108.402126:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587108.402129:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587108.402143:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309931904 00000100:00100000:1.0:1788587108.402147:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309931904 00000100:00100000:3.0:1788587108.402160:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309931392:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.402173:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309932416 00000100:00100000:3.0:1788587108.402174:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788587108.402178:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309932416 00000100:00100000:3.0:1788587108.402185:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309932288:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.402197:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788587108.402206:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309931904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587108.402216:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587108.402242:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309932800:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.402250:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309931904:12345-0@lo:400:kworker.0 Request processed in 44us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587108.402257:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788587108.402271:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587108.402274:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788587108.402282:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309932416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587108.402300:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309931904:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.402320:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309932416:12345-0@lo:400:kworker.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587108.402325:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309932416:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.402339:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788587108.402362:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309932288 00000100:00080000:1.0:1788587108.402365:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587108.402391:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309932288 00000100:00100000:3.0:1788587108.402433:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309932800 00000100:00100000:3.0:1788587108.402436:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309932800 00000100:00100000:1.0:1788587108.402460:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788587108.402470:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309932288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587108.402474:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587108.402486:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309932800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.402520:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309932288:12345-0@lo:400:kworker.0 Request processed in 52us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587108.402528:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587108.402536:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309932800:12345-0@lo:400:kworker.0 Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587108.402544:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788587108.402549:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587108.402554:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587108.402575:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacfb80 x1875469309932288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587108.402586:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309932288:0@lo:400:kworker.0 00010000:00080000:1.0:1788587108.402596:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacd180 x1875469309932800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587108.402604:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309932800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.405517:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587108.405582:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309932160:0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.405617:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587108.405659:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309932672:0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.405684:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587108.405698:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309932160 00000100:00100000:1.0:1788587108.405708:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309932160 00000100:00100000:0.0:1788587108.405746:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309932672 00000100:00100000:0.0:1788587108.405752:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309932672 00000100:00100000:1.0:1788587108.405771:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587108.405782:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309932160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587108.405825:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309931648 00000100:00100000:3.0:1788587108.405830:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309931648 00000100:00100000:1.0:1788587108.405867:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309932160:12345-0@lo:400:kworker.0 Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587108.405879:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788587108.405888:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309931648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587108.405925:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309931648:12345-0@lo:400:kworker.0 Request processed in 39us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587108.405932:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1788587108.405966:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587108.405971:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788587108.405972:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587108.405997:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309931264 00000100:00100000:3.0:1788587108.407454:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309931264 00000100:00100000:3.0:1788587108.407537:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309931648:0@lo:400:kworker.0 00010000:00080000:3.0:1788587108.407555:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacce00 x1875469309932160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587108.407565:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309932160:0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.408266:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788587108.408288:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309932672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.408388:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309932672:12345-0@lo:400:kworker.0 Request processed in 111us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587108.408396:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788587108.408439:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3baced80 x1875469309932672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587108.408451:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309932672:0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.408507:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309931776:0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.408545:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587108.408581:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309931776 00000100:00100000:0.0:1788587108.408586:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309931776 00000100:00100000:0.0:1788587108.408619:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788587108.408626:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309931776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587108.408675:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309931776:12345-0@lo:400:kworker.0 Request processed in 49us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587108.408681:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788587108.408707:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309931776:0@lo:400:kworker.0 00000100:00100000:2.0:1788587108.409111:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788587108.409121:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309931264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587108.409166:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309931264:12345-0@lo:400:kworker.0 Request processed in 47us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587108.409172:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788587108.411625:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309931264:0@lo:400:kworker.0 00000100:00100000:1.0:1788587108.412891:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1788587108.780021:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587108.907063:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309932928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587108.907150:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587108.907260:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309932928 00000100:00100000:2.0:1788587108.907269:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309932928 00000100:00100000:2.0:1788587108.907323:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587108.907333:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309932928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587108.907368:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587108.907416:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309932928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587108.907423:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1788587108.907464:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd55180 x1875469309932928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587108.907500:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309932928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587108.907667:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587108.907678:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309933056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587108.907710:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587108.908069:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309933056 00000100:00100000:2.0:1788587108.908075:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309933056 00000100:00100000:2.0:1788587108.908111:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788587108.908119:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309933056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587108.908131:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587108.908164:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309933056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587108.908169:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1788587108.908949:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc3b80 x1875469309933056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587108.908979:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309933056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587109.532155:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587109.532357:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587109.532419:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587109.532447:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292028544 00000100:00100000:3.0:1788587109.532463:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292028544 00000100:00100000:3.0:1788587109.532517:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 309 00000100:00100000:3.0:1788587109.532527:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2410:x1875469292028544:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587109.532601:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2410:x1875469292028544:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 75us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587109.532609:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 309 00000100:00100000:2.0:1788587109.538815:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587109.541063:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292028800 00000100:00100000:1.0:1788587109.541079:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292028800 00000100:00100000:3.0:1788587109.542198:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292029056 00000100:00100000:3.0:1788587109.542209:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292029056 00000100:00100000:3.0:1788587109.542252:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 163 00000100:00100000:3.0:1788587109.542263:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292028800:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587109.542348:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292028800:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 86us (9991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587109.542356:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 163 00000100:00100000:3.0:1788587109.542375:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:3.0:1788587109.542381:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292029056:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587109.542411:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292029056:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 30us (9992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587109.542417:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:2.0:1788587109.542872:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292028672 00000100:00100000:2.0:1788587109.542879:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292028672 00000100:00100000:2.0:1788587109.542914:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 165 00000100:00100000:2.0:1788587109.542921:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292028672:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587109.542955:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292028672:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 35us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.542961:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 165 00000100:00100000:2.0:1788587109.543016:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587109.543080:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587109.543123:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587109.543144:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292028928 00000100:00100000:2.0:1788587109.543148:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292028928 00000100:00100000:2.0:1788587109.543186:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00100000:2.0:1788587109.543193:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292028928:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587109.543225:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292028928:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 32us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.543232:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00100000:2.0:1788587109.543251:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292029184 00000100:00100000:2.0:1788587109.543255:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292029184 00000100:00100000:2.0:1788587109.543278:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292029312 00000100:00100000:2.0:1788587109.543281:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292029312 00000100:00100000:2.0:1788587109.543305:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788587109.543313:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2408:x1875469292029184:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:2.0:1788587109.543332:0:8101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343950 00000100:00080000:2.0:1788587109.543340:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbe04fd7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587109.543378:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788587109.543623:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+2:2408:x1875469292029184:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 311us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.543643:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788587109.543657:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788587109.543664:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2408:x1875469292029312:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:2.0:1788587109.543676:0:8101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343957 00000100:00080000:2.0:1788587109.543681:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbf05223000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587109.543702:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788587109.543883:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+2:2408:x1875469292029312:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 219us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.543890:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00010000:00010000:2.0:1788587109.543922:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587109.543934:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587109.544750:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587109.544767:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587109.544771:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587109.544775:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788587109.804887:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587109.931107:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587109.931129:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309933184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587109.931193:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587109.931284:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309933184 00000100:00100000:2.0:1788587109.931299:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309933184 00000100:00100000:2.0:1788587109.931345:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788587109.931353:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309933184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587109.931384:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587109.931439:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309933184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.931446:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1788587109.931527:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a6680 x1875469309933184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587109.931545:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309933184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587109.933088:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309933312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587109.933148:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587109.933373:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309933440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587109.933407:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587109.933825:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309933440 00000100:00100000:0.0:1788587109.933833:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309933440 00000100:00100000:0.0:1788587109.933946:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788587109.933955:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309933440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587109.933993:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587109.934050:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309933440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587109.934057:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587109.934117:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309933440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587109.934129:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309933312 00000100:00100000:3.0:1788587109.934133:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309933312 00000100:00100000:3.0:1788587109.934181:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788587109.934188:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309933312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587109.934203:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587109.934243:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309933312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587109.934250:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788587109.934983:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc3b80 x1875469309933312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587109.935002:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309933312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587110.443704:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309933568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587110.443865:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587110.444818:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309933568 00000100:00100000:2.0:1788587110.444932:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309933568 00000100:00100000:2.0:1788587110.444991:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587110.445000:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309933568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587110.445038:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587110.445100:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309933568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587110.445107:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587110.445157:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309933568:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1788587110.492773:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bb361c2-21de-4228-8a96-92f24b49adc6 00000020:00000080:3.0:1788587110.492784:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbe04fd2000/7bb361c2-21de-4228-8a96-92f24b49adc6 00000020:00000080:0.0:1788587110.493026:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe04fd2000/7bb361c2-21de-4228-8a96-92f24b49adc6 for lustre-OST0000 00000020:00000080:0.0:1788587110.493080:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe04fd7000 for lustre-OST0000 00010000:00010000:3.0:1788587110.827021:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587111.852574:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788587112.079714:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bb361c2-21de-4228-8a96-92f24b49adc6 00000020:00000080:2.0:1788587112.079724:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbf05221800/7bb361c2-21de-4228-8a96-92f24b49adc6 00000020:00000080:1.0:1788587112.079995:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf05221800/7bb361c2-21de-4228-8a96-92f24b49adc6 for lustre-OST0001 00000020:00000080:1.0:1788587112.080165:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf05223000 for lustre-OST0001 00010000:00010000:2.0:1788587112.874896:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587113.209314:0:12613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788587113.515641:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309933824:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.515721:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587113.515787:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309934336:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.515854:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587113.516070:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309933824 00000100:00100000:0.0:1788587113.516079:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309933824 00000100:00100000:0.0:1788587113.516129:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309934336 00000100:00100000:0.0:1788587113.516132:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309934336 00000100:00100000:0.0:1788587113.516163:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788587113.516172:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309933824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587113.516228:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309933824:12345-0@lo:400:kworker.0 Request processed in 58us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.516236:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788587113.516253:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788587113.516260:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309934336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587113.516299:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309934336:12345-0@lo:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.516305:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788587113.516701:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309934848:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.516737:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587113.516827:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309933824:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.516845:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309934336:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.516862:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788587113.516870:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309933952:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.517074:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587113.517106:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309934464:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.517126:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587113.517147:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309934976:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.517165:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587113.517205:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309934848 00000100:00100000:3.0:1788587113.517210:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309934848 00000100:00100000:3.0:1788587113.517239:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309934464 00000100:00100000:3.0:1788587113.517242:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309934464 00000100:00100000:3.0:1788587113.517253:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309934976 00000100:00100000:3.0:1788587113.517255:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309934976 00000100:00100000:3.0:1788587113.517267:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788587113.517273:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309934848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.517312:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309934848:12345-0@lo:400:kworker.0 Request processed in 40us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.517317:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788587113.517329:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788587113.517334:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309934464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.517358:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309934464:12345-0@lo:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.517432:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788587113.517511:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788587113.517519:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309934976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.517547:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309934976:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.517552:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00010000:00080000:3.0:1788587113.517582:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18715f80 x1875469309934464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587113.517592:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309934464:0@lo:400:kworker.0 00010000:00080000:3.0:1788587113.517612:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18714380 x1875469309934976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587113.517632:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309934976:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.517644:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309934848:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.517858:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309933696:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.518020:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587113.518058:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309934208:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.518082:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587113.518111:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309934720:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.518133:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587113.518150:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309935232:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.518169:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587113.518188:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788587113.518194:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309934080:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.518213:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587113.518231:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309934592:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.518249:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587113.518263:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309935104:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.518295:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587113.518318:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587113.518322:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587113.518331:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309934080 00000100:00100000:1.0:1788587113.518335:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309934080 00000100:00100000:1.0:1788587113.518383:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788587113.518391:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309934080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.518427:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309934080:12345-0@lo:400:kworker.0 Request processed in 38us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587113.518433:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788587113.518789:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309934080:0@lo:400:kworker.0 00000100:00100000:0.0:1788587113.519041:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309933696 00000100:00100000:0.0:1788587113.519046:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309933696 00000100:00100000:0.0:1788587113.519087:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788587113.519095:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309933696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587113.519138:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309933696:12345-0@lo:400:kworker.0 Request processed in 44us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.519144:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788587113.519260:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309933952 00000100:00100000:2.0:1788587113.519266:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309933952 00000100:00100000:2.0:1788587113.519287:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309934208 00000100:00100000:2.0:1788587113.519289:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309934208 00000100:00100000:2.0:1788587113.519301:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587113.519306:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309933952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587113.519348:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309933952:12345-0@lo:400:kworker.0 Request processed in 42us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.519355:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587113.519379:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788587113.519385:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309934208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587113.519413:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309934208:12345-0@lo:400:kworker.0 Request processed in 28us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.519419:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788587113.519437:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309934720 00000100:00100000:2.0:1788587113.519440:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309934720 00000100:00100000:2.0:1788587113.519476:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309935232 00000100:00100000:2.0:1788587113.519479:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309935232 00000100:00100000:2.0:1788587113.519489:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309934592 00000100:00100000:2.0:1788587113.519491:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309934592 00000100:00100000:2.0:1788587113.519502:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309935104 00000100:00100000:2.0:1788587113.519504:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309935104 00000100:00100000:2.0:1788587113.519516:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788587113.519522:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309934720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587113.519552:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309934720:12345-0@lo:400:kworker.0 Request processed in 30us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.519558:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788587113.519569:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788587113.519575:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309935232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587113.519624:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309935232:12345-0@lo:400:kworker.0 Request processed in 49us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.519630:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788587113.519642:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788587113.519648:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309934592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587113.519675:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309934592:12345-0@lo:400:kworker.0 Request processed in 27us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.519681:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788587113.520003:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788587113.520012:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309935104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587113.520045:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309935104:12345-0@lo:400:kworker.0 Request processed in 36us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.520051:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788587113.520095:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309933952:0@lo:400:kworker.0 00000100:00080000:1.0:1788587113.520402:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587113.520407:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587113.520430:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18716d80 x1875469309934592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587113.520453:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309934592:0@lo:400:kworker.0 00010000:00080000:1.0:1788587113.520466:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18714e00 x1875469309935104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587113.520475:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309935104:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.520484:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309933696:0@lo:400:kworker.0 00000100:00100000:1.0:1788587113.520494:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309934208:0@lo:400:kworker.0 00010000:00080000:1.0:1788587113.520503:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18717100 x1875469309934720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587113.520511:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309934720:0@lo:400:kworker.0 00010000:00080000:1.0:1788587113.520532:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18714a80 x1875469309935232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587113.520541:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309935232:0@lo:400:kworker.0 00010000:00010000:1.0:1788587113.901761:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587114.028847:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309935360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587114.028919:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587114.029007:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309935360 00000100:00100000:2.0:1788587114.029016:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309935360 00000100:00100000:2.0:1788587114.029060:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788587114.029069:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309935360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587114.029117:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587114.029159:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309935360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.029166:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1788587114.029202:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a6680 x1875469309935360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587114.029232:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309935360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587114.030810:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309935488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587114.030868:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587114.030922:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309935488 00000100:00100000:2.0:1788587114.030929:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309935488 00000100:00100000:2.0:1788587114.030969:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788587114.030977:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309935488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587114.030997:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587114.031034:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309935488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.031040:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788587114.031300:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18715c00 x1875469309935488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587114.031317:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309935488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587114.645078:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587114.645116:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587114.645133:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587114.645147:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587114.645166:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587114.645189:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292029696 00000100:00100000:2.0:1788587114.645198:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292029696 00000100:00100000:2.0:1788587114.645244:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292029952 00000100:00100000:2.0:1788587114.645247:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292029952 00000100:00100000:2.0:1788587114.645262:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292029568 00000100:00100000:2.0:1788587114.645265:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292029568 00000100:00100000:2.0:1788587114.645275:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292029824 00000100:00100000:2.0:1788587114.645277:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292029824 00000100:00100000:2.0:1788587114.645291:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 173 00000100:00100000:2.0:1788587114.645300:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292029696:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587114.645381:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292029696:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 82us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.645389:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 173 00000100:00100000:2.0:1788587114.645406:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 174 00000100:00100000:2.0:1788587114.645413:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292029952:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587114.645438:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292029952:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.645444:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 174 00000100:00100000:2.0:1788587114.645455:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 175 00000100:00100000:2.0:1788587114.645461:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292029568:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587114.645483:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292029568:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.645490:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 175 00000100:00100000:2.0:1788587114.645500:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 176 00000100:00100000:2.0:1788587114.645506:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292029824:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587114.645526:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292029824:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 20us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.645532:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 176 00000100:00080000:1.0:1788587114.645576:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587114.645581:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587114.646168:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292029440 00000100:00100000:1.0:1788587114.646174:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292029440 00000100:00100000:1.0:1788587114.646219:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 311 00000100:00100000:1.0:1788587114.646227:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292029440:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587114.646256:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292029440:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 31us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587114.646263:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 311 00010000:00010000:0.0:1788587114.927552:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587115.051983:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587115.052005:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309935616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587115.052076:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587115.052136:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309935616 00000100:00100000:2.0:1788587115.052143:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309935616 00000100:00100000:2.0:1788587115.052187:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788587115.052218:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309935616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587115.052255:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587115.052301:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309935616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587115.052308:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788587115.052354:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309935616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587115.053909:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587115.053929:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309935744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587115.054105:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587115.054631:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309935744 00000100:00100000:1.0:1788587115.054639:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309935744 00000100:00100000:1.0:1788587115.054693:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788587115.054702:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309935744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587115.054734:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587115.054781:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309935744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587115.054788:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788587115.055480:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05737800 x1875469309935744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587115.055505:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309935744:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788587115.055580:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587115.064626:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309935872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587115.064701:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587115.068660:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309935872 00000100:00100000:1.0:1788587115.068673:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309935872 00000100:00100000:1.0:1788587115.068744:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788587115.068755:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309935872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587115.068822:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587115.068909:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309935872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (4207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587115.068916:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788587115.068976:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc2680 x1875469309935872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587115.068997:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309935872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788587115.070178:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587115.563331:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587115.563361:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309936000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587115.563431:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587115.563494:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309936000 00000100:00100000:2.0:1788587115.563501:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309936000 00000100:00100000:2.0:1788587115.563541:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587115.563550:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309936000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587115.563597:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587115.563643:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309936000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587115.563650:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587115.563695:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309936000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587115.947010:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587116.396695:0:12761:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffab2b6c00 20000000:00000080:3.0:1788587116.396712:0:12761:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbf35f76c00 uarg=0000000000000000 20000000:01000000:3.0:1788587116.396744:0:12761:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788587116.396749:0:12761:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788587116.396753:0:12761:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788587116.399443:0:12762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788587116.399597:0:12761:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788587116.407368:0:12761:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788587116.407403:0:12761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407441:0:12761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407448:0:12761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407454:0:12761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634390a expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407462:0:12761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407469:0:12761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634391f expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407476:0:12761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407482:0:12761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407523:0:12761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407535:0:12761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 12 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.407549:0:12761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936128:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587116.407665:0:12761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634391f expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407679:0:12761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634391f expref: 23 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.407689:0:12761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936256:0@lo:104: 00000100:00100000:2.0:1788587116.407727:0:12761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587116.407767:0:12761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407775:0:12761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 12 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.407783:0:12761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936384:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587116.407850:0:12761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634390a expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.407858:0:12761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634390a expref: 23 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.407865:0:12761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936512:0@lo:104: 00000100:00100000:2.0:1788587116.407886:0:12761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587116.409458:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309936256 00000100:00100000:3.0:1788587116.409470:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309936256 00000100:00100000:3.0:1788587116.409525:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309936512 00000100:00100000:3.0:1788587116.409528:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309936512 00000100:00100000:3.0:1788587116.409543:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788587116.409550:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:12761:x1875469309936256:12345-0@lo:104: 00010000:00010000:3.0:1788587116.409567:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587116.409652:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587116.409658:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+4:12761:x1875469309936256:12345-0@lo:104: Request processed in 108us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587116.409664:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788587116.409680:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587116.409686:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:12761:x1875469309936512:12345-0@lo:104: 00010000:00010000:3.0:1788587116.409694:0:6455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.410380:0:12761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.410395:0:12761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 23 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.410406:0:12761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05736680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936640:0@lo:104: 00000100:00100000:2.0:1788587116.410443:0:12761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587116.410478:0:12761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.410486:0:12761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 23 pid: 6467 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.410494:0:12761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936768:0@lo:104: 00000100:00100000:2.0:1788587116.410513:0:12761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587116.410522:0:12761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587116.410541:0:12761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936256:0@lo:104: 00000100:00100000:1.0:1788587116.410580:0:9059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309936640 00000100:00100000:1.0:1788587116.410594:0:9059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309936640 00000100:00100000:1.0:1788587116.410617:0:9059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309936768 00000100:00100000:1.0:1788587116.410620:0:9059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309936768 00000100:00100000:1.0:1788587116.410632:0:9059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587116.410639:0:9059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+5:12761:x1875469309936640:12345-0@lo:104: 00010000:00010000:1.0:1788587116.410649:0:9059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410692:0:9059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788587116.410697:0:9059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+5:12761:x1875469309936640:12345-0@lo:104: Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587116.410703:0:9059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587116.410717:0:9059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587116.410722:0:9059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+4:12761:x1875469309936768:12345-0@lo:104: 00010000:00010000:1.0:1788587116.410728:0:9059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410759:0:9059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788587116.410764:0:9059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b5a87955-d364-4ecd-b672-456c35aa135f+4:12761:x1875469309936768:12345-0@lo:104: Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587116.410776:0:9059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788587116.410811:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587116.410817:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410823:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587116.410828:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410837:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587116.410844:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587116.410851:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788587116.410879:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410886:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587116.410916:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410924:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37105000/0x419e1ae1f634391f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343926 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410938:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587116.410941:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410956:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587116.410959:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410965:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587116.410970:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587116.410975:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788587116.410988:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.410993:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587116.410999:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411004:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37105c00/0x419e1ae1f63438fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343903 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411012:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587116.411014:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411019:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587116.411021:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411035:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587116.411041:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587116.411046:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788587116.411057:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411062:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587116.411087:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411094:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f63438ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63438f5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411102:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587116.411104:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587116.411106:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587116.411122:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309936896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587116.411148:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587116.411169:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587116.411174:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309937024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587116.411191:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587116.411216:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309937152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587116.411235:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587116.411263:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309936896 00000100:00100000:1.0:1788587116.411274:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309936896 00010000:00010000:1.0:1788587116.411294:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634391f expref: 24 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587116.411307:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309937024 00000100:00100000:1.0:1788587116.411309:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309937024 00010000:00010000:1.0:1788587116.411317:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 25 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587116.411325:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309937152 00000100:00100000:1.0:1788587116.411327:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309937152 00010000:00010000:1.0:1788587116.411335:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 26 pid: 6467 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587116.411344:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587116.411349:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+26:3474:x1875469309936896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587116.411358:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587116.411363:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634391f expref: 26 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411372:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634391f expref: 26 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411384:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f6343926 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634391f expref: 26 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411397:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587116.411424:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+25:3474:x1875469309936896:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587116.411430:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587116.411443:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587116.411455:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309937024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587116.411462:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587116.411466:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 24 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411473:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 24 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411482:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587116.411503:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309937024:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587116.411508:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587116.411518:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587116.411523:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+23:3472:x1875469309937152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587116.411530:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587116.411533:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 23 pid: 6467 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411541:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 23 pid: 6467 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.411549:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587116.411573:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+23:3472:x1875469309937152:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587116.411579:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587116.411615:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309937152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587116.411638:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309937024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587116.411645:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309936896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587116.412028:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587116.413094:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587116.413487:0:6455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587116.413498:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5a87955-d364-4ecd-b672-456c35aa135f+3:12761:x1875469309936512:12345-0@lo:104: Request processed in 3810us (5608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587116.413508:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788587116.413635:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587116.413643:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.413652:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587116.413656:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.413664:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587116.413671:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587116.413676:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788587116.413717:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.413724:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587116.413741:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.413747:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f634390a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343911 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.413761:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587116.413762:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587116.413764:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587116.413776:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309937280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587116.413851:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587116.414035:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309937280 00000100:00100000:1.0:1788587116.414042:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309937280 00010000:00010000:1.0:1788587116.414079:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634390a expref: 23 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587116.414103:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587116.414111:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+23:3473:x1875469309937280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587116.414122:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587116.414127:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634390a expref: 23 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.414136:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634390a expref: 23 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.414151:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587116.414194:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+23:3473:x1875469309937280:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587116.414200:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587116.414233:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309937280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587116.414438:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587116.414526:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587116.414545:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292030208 00000100:00100000:0.0:1788587116.414549:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292030208 00010000:00010000:0.0:1788587116.414568:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 13 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587116.414590:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292030080 00000100:00100000:0.0:1788587116.414593:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292030080 00010000:00010000:0.0:1788587116.414602:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 14 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587116.414615:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:0.0:1788587116.414621:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4b0c77f-670d-4698-a42c-a862f5ca1366+14:2411:x1875469292030208:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587116.414630:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587116.414641:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 14 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414650:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 14 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414661:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587116.414696:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4b0c77f-670d-4698-a42c-a862f5ca1366+14:2411:x1875469292030208:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587116.414702:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:0.0:1788587116.414716:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:0.0:1788587116.414721:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292030080:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587116.414728:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587116.414732:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 13 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414741:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 13 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414753:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414761:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414775:0:6459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414782:0:6459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414819:0:6459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414826:0:6459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414831:0:6459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587116.414836:0:6459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414844:0:6459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414853:0:6459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587116.414863:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587116.414884:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292030080:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 161us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587116.414891:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00010000:00010000:2.0:1788587116.415523:0:12761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42045800/0x419e1ae1f6343911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634390a expref: 22 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.415539:0:12761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936512:0@lo:104: 00010000:00010000:2.0:1788587116.415551:0:12761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343903 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63438fc expref: 21 pid: 6465 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.415560:0:12761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05736680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936640:0@lo:104: 00010000:00010000:2.0:1788587116.415569:0:12761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37104200/0x419e1ae1f63438f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63438ee expref: 20 pid: 6467 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.415576:0:12761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936768:0@lo:104: 00010000:00010000:2.0:1788587116.415598:0:12761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37105a00/0x419e1ae1f634393b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd575e expref: 12 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.415606:0:12761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936128:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587116.415614:0:12761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cca00/0x419e1ae1f6343918 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd571f expref: 11 pid: 6464 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587116.415637:0:12761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12761:1875469309936384:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587116.415667:0:12761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.415675:0:12761:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.415681:0:12761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587116.415686:0:12761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f634395e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587116.971053:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587118.000874:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587118.034002:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587118.034039:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292030336 00000100:00100000:3.0:1788587118.034048:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292030336 00000100:00100000:3.0:1788587118.034109:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 312 00000100:00100000:3.0:1788587118.034119:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:6383:x1875469292030336:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587118.034135:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587118.034152:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd578f expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.034179:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.034191:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.034208:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105e00, rc 0) 00000100:00100000:3.0:1788587118.034261:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292030336:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 143us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587118.034268:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 312 00000100:00100000:0.0:1788587118.041963:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587118.042067:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292030464 00000100:00100000:2.0:1788587118.042078:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292030464 00000100:00100000:2.0:1788587118.042138:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 313 00000100:00100000:2.0:1788587118.042149:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292030464:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587118.042440:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292030464:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 291us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587118.042448:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 313 00000100:00100000:3.0:1788587118.044066:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587118.044152:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292030592 00000100:00100000:0.0:1788587118.044161:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292030592 00000100:00100000:0.0:1788587118.044215:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 314 00000100:00100000:0.0:1788587118.044224:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292030592:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587118.044428:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292030592:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 203us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.044436:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 314 00000100:00100000:0.0:1788587118.052315:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587118.052542:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292030720 00000100:00100000:3.0:1788587118.052552:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292030720 00000100:00100000:3.0:1788587118.052618:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 315 00000100:00100000:3.0:1788587118.052628:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292030720:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587118.052644:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587118.052662:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5796 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.052690:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.052702:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.052712:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37104600, rc 0) 00000100:00100000:3.0:1788587118.052775:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292030720:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 147us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587118.053182:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 315 00000100:00100000:3.0:1788587118.058873:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587118.059275:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292030848 00000100:00100000:2.0:1788587118.059286:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292030848 00000100:00100000:2.0:1788587118.059345:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 316 00000100:00100000:2.0:1788587118.059356:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292030848:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587118.059655:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292030848:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 300us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587118.059673:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 316 00000100:00100000:3.0:1788587118.061945:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587118.062076:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292030976 00000100:00100000:1.0:1788587118.062085:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292030976 00000100:00100000:1.0:1788587118.062139:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 317 00000100:00100000:1.0:1788587118.062150:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292030976:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.062350:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292030976:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 201us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.062358:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 317 10000000:01000000:3.0:1788587118.186917:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587118.186936:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe040c5800 from 7 10000000:01000000:3.0:1788587118.186941:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587118.186987:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.187001:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.187012:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587118.187036:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587118.187108:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587118.187217:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3736b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587118.187274:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309937408 00000100:00100000:0.0:1788587118.187282:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309937408 00000100:00100000:0.0:1788587118.187335:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788587118.187345:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309937408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587118.187358:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587118.187371:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343973 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.187407:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.187419:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.187428:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483400, rc 0) 00000100:00100000:0.0:1788587118.187654:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309937408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 310us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.187661:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788587118.190648:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587118.190679:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.190693:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587118.190863:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587118.190918:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587118.191036:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3736b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587118.193557:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309937536 00000100:00100000:0.0:1788587118.194480:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309937536 00000100:00100000:1.0:1788587118.194707:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788587118.194723:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309937536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.195041:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309937536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (4121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.195050:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788587118.195219:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587118.195268:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587118.195312:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587118.195349:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3736b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587118.195859:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309937664 00000100:00100000:0.0:1788587118.195865:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309937664 00000100:00100000:0.0:1788587118.195906:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788587118.195915:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309937664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587118.196076:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309937664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.196084:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788587118.196507:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788587118.198193:0:12818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788587118.198484:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788587118.198516:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587118.198527:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.198538:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587118.198547:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587118.198549:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf3d10b000 from 7 10000000:01000000:0.0:1788587118.198552:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587118.198597:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.198605:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.198615:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587118.198641:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587118.198700:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587118.198744:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ff780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587118.200218:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309937792 00000100:00100000:3.0:1788587118.200231:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309937792 00000100:00100000:3.0:1788587118.203663:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788587118.203689:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309937792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587118.203710:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587118.203731:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343981 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.203765:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 22 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.203777:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 22 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587118.203786:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37104200, rc 0) 00000100:00100000:3.0:1788587118.203876:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309937792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587118.203883:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788587118.204025:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587118.204044:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.204053:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587118.204124:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587118.204168:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587118.207867:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587118.207948:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309937920 00000100:00100000:1.0:1788587118.207956:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309937920 00000100:00100000:1.0:1788587118.208005:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788587118.208014:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309937920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.208279:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309937920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (4109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.208286:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788587118.208334:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309937920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.208389:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.208427:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.208440:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587118.208450:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309938048 00000100:00100000:1.0:1788587118.208453:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309938048 00000100:00100000:1.0:1788587118.208587:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788587118.208596:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309938048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.208731:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309938048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.208737:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788587118.208769:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587118.209677:0:12819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788587118.209745:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788587118.209775:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587118.209785:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.209820:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587118.209831:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587118.209833:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf04818800 from 7 10000000:01000000:1.0:1788587118.209836:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587118.209865:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.209872:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.209883:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587118.209901:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.209947:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.209967:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587118.209982:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309938176 00000100:00100000:1.0:1788587118.209986:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309938176 00000100:00100000:1.0:1788587118.210011:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788587118.210017:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309938176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587118.210027:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587118.210037:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634398f expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.210068:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634398f expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.210077:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634398f expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.210085:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd400, rc 0) 00000100:00100000:1.0:1788587118.210117:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309938176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.210123:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788587118.210159:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587118.210171:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.210179:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587118.210220:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.210244:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.210257:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587118.210268:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309938304 00000100:00100000:1.0:1788587118.210271:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309938304 00000100:00100000:1.0:1788587118.210288:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788587118.210294:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309938304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.211861:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309938304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1560us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.211885:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788587118.211941:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.211983:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.212024:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.212052:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587118.212066:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309938432 00000100:00100000:1.0:1788587118.212072:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309938432 00000100:00100000:1.0:1788587118.212098:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788587118.212107:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309938432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.212247:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309938432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.212255:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788587118.212290:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587118.222271:0:12820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788587118.222336:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788587118.222356:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587118.222367:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.223703:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587118.223718:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587118.223721:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf11802800 from 7 10000000:01000000:1.0:1788587118.223723:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587118.223764:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.223778:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.223789:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587118.223837:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.223907:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.223947:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587118.224064:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309938560 00000100:00100000:2.0:1788587118.224071:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309938560 00000100:00100000:2.0:1788587118.224113:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788587118.224121:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309938560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587118.224134:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587118.224146:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634399d expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587118.224170:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634399d expref: 24 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587118.224181:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634399d expref: 24 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587118.224190:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044000, rc 0) 00000100:00100000:2.0:1788587118.224231:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309938560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587118.224237:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788587118.226031:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587118.226059:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.226071:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587118.226145:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.226197:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.226243:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587118.228585:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309938688 00000100:00100000:3.0:1788587118.228600:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309938688 00000100:00100000:3.0:1788587118.228658:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788587118.228669:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309938688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587118.228970:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309938688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (2772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587118.228978:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788587118.229079:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.229123:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587118.229162:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.229231:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587118.230751:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309938816 00000100:00100000:3.0:1788587118.231023:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309938816 00000100:00100000:2.0:1788587118.231131:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788587118.231140:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309938816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587118.231363:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309938816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587118.231370:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788587118.231580:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309938816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788587118.232701:0:12825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788587118.232982:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788587118.233005:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587118.233016:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.233027:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587118.637053:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309939200:0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.637104:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309938944:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637120:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.637187:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309939712:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637228:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587118.637230:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309939072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637247:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309940224:0@lo:400:kworker.0 00000100:00100000:2.0:1788587118.637259:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.637268:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309939328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587118.637284:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309939584:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637287:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.637301:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309939840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587118.637305:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587118.637319:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309940096:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637321:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587118.637336:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.637336:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309940352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637352:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.637380:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309939200 00000100:00100000:1.0:1788587118.637388:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309939200 00000100:00100000:1.0:1788587118.637434:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587118.637442:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309939200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637485:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309939200:12345-0@lo:400:kworker.0 Request processed in 44us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.637493:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587118.637514:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309939712 00000100:00100000:1.0:1788587118.637518:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309939712 00000100:00100000:1.0:1788587118.637545:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309939072 00000100:00100000:1.0:1788587118.637548:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309939072 00000100:00100000:1.0:1788587118.637557:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309939328 00000100:00100000:1.0:1788587118.637559:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309939328 00000100:00100000:1.0:1788587118.637595:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309939584 00000100:00100000:1.0:1788587118.637598:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309939584 00000100:00100000:0.0:1788587118.637611:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.637612:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309940096 00000100:00100000:1.0:1788587118.637613:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309940096 00000100:00100000:1.0:1788587118.637626:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788587118.637632:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309939712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.637639:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309939456:0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.637663:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.637666:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309939712:12345-0@lo:400:kworker.0 Request processed in 34us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.637672:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788587118.637677:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309939968:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637685:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788587118.637690:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309939072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.637695:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587118.637710:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309940480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637717:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309939072:12345-0@lo:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.637723:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788587118.637728:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.637734:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788587118.637740:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309939328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.637756:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309938944 00000100:00100000:0.0:1788587118.637759:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309938944 00000100:00100000:1.0:1788587118.637767:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309939328:12345-0@lo:400:kworker.0 Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.637773:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788587118.637784:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788587118.637784:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788587118.637789:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309939584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.637789:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309938944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637832:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309939584:12345-0@lo:400:kworker.0 Request processed in 43us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.637833:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309938944:12345-0@lo:400:kworker.0 Request processed in 44us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.637838:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788587118.637838:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788587118.637849:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788587118.637854:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309940096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.637871:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309939840 00000100:00100000:0.0:1788587118.637874:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309939840 00000100:00100000:1.0:1788587118.637877:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309940096:12345-0@lo:400:kworker.0 Request processed in 24us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.637882:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788587118.637890:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309940352 00000100:00100000:0.0:1788587118.637892:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309940352 00000100:00100000:0.0:1788587118.637903:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309939968 00000100:00100000:0.0:1788587118.637905:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309939968 00000100:00100000:1.0:1788587118.637907:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309940480 00000100:00100000:1.0:1788587118.637910:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309940480 00000100:00100000:0.0:1788587118.637917:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788587118.637922:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309939840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637930:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587118.637935:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309940352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.637960:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309940352:12345-0@lo:400:kworker.0 Request processed in 24us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.637962:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309939840:12345-0@lo:400:kworker.0 Request processed in 40us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.637965:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788587118.637968:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788587118.637977:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788587118.637982:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309939968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587118.638128:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309939456 00000100:00100000:2.0:1788587118.638132:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309939456 00000100:00100000:2.0:1788587118.638644:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788587118.638651:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309939456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587118.638690:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309939456:12345-0@lo:400:kworker.0 Request processed in 40us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587118.638696:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587118.638764:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788587118.638774:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309940480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.638824:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309940480:12345-0@lo:400:kworker.0 Request processed in 53us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.638829:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788587118.638850:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587118.638854:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587118.638856:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587118.638858:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587118.638890:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309939072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.638901:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309939584:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.638911:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309940096:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.638946:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309939328:0@lo:400:kworker.0 00010000:00080000:1.0:1788587118.638959:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacce00 x1875469309939840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587118.638968:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309939840:0@lo:400:kworker.0 00010000:00080000:1.0:1788587118.638977:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9ce00 x1875469309940352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587118.638984:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309940352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.639018:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.639061:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309939200:0@lo:400:kworker.0 00010000:00080000:1.0:1788587118.639071:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacea00 x1875469309939712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587118.639078:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309939712:0@lo:400:kworker.0 00000100:00100000:2.0:1788587118.639312:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309940224 00000100:00100000:2.0:1788587118.639317:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309940224 00000100:00100000:2.0:1788587118.639358:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788587118.639365:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309940224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587118.639409:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309940224:12345-0@lo:400:kworker.0 Request processed in 44us (390us total) trans 0 rc 0/0 00000100:00080000:1.0:1788587118.639409:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587118.639415:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00010000:00080000:1.0:1788587118.639426:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9c700 x1875469309940224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587118.639435:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309940224:0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.639656:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309939968:12345-0@lo:400:kworker.0 Request processed in 1673us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.639663:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788587118.639699:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309938944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.639710:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309939456:0@lo:400:kworker.0 00010000:00080000:0.0:1788587118.639720:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a6680 x1875469309939968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587118.639728:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309939968:0@lo:400:kworker.0 00010000:00080000:0.0:1788587118.639738:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9f100 x1875469309940480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587118.639744:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309940480:0@lo:400:kworker.0 00010000:00010000:0.0:1788587119.019152:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587119.150745:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587119.150768:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309940608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587119.150993:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587119.155332:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309940608 00000100:00100000:1.0:1788587119.155348:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309940608 00000100:00100000:1.0:1788587119.155402:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788587119.155413:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309940608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587119.155449:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587119.156762:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309940608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1344us (5762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587119.156775:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1788587119.160079:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ccc3b80 x1875469309940608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587119.160108:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309940608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587119.160144:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587119.160156:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309940736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587119.162192:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587119.162302:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309940736 00000100:00100000:1.0:1788587119.162317:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309940736 00000100:00100000:1.0:1788587119.162365:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788587119.162374:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309940736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587119.162399:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587119.162456:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309940736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587119.162462:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788587119.162502:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05e09180 x1875469309940736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587119.162529:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309940736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587119.765262:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587119.765301:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587119.765329:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587119.765347:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587119.765368:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587119.765394:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292031232 00000100:00100000:3.0:1788587119.765405:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292031232 00000100:00100000:3.0:1788587119.765453:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292031488 00000100:00100000:3.0:1788587119.765456:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292031488 00000100:00100000:3.0:1788587119.765470:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292031360 00000100:00100000:3.0:1788587119.765472:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292031360 00000100:00100000:3.0:1788587119.765483:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292031616 00000100:00100000:3.0:1788587119.765485:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292031616 00000100:00100000:3.0:1788587119.765500:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 183 00000100:00100000:3.0:1788587119.765508:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292031232:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587119.765585:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292031232:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 76us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587119.765593:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 183 00000100:00100000:3.0:1788587119.765609:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:3.0:1788587119.765616:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292031488:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587119.765641:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292031488:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587119.765647:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:3.0:1788587119.765666:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:3.0:1788587119.765672:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292031360:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587119.765699:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292031360:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587119.765705:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:3.0:1788587119.765716:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:3.0:1788587119.765723:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292031616:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587119.765748:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292031616:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587119.765754:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:3.0:1788587119.765779:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292031104 00000100:00100000:3.0:1788587119.765783:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292031104 00000100:00100000:3.0:1788587119.765829:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 331 00000100:00100000:3.0:1788587119.765837:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292031104:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587119.765862:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292031104:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587119.765869:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 331 00000100:00080000:3.0:1788587119.765904:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587119.769186:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587120.043969:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587120.171242:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309940864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587120.171318:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587120.171398:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309940864 00000100:00100000:3.0:1788587120.171406:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309940864 00000100:00100000:3.0:1788587120.171458:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587120.171468:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309940864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587120.171510:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587120.171568:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309940864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587120.171575:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788587120.171597:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587120.171722:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309940992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587120.171752:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587120.171790:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309940992 00000100:00100000:2.0:1788587120.171825:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309940992 00000100:00100000:2.0:1788587120.171858:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788587120.171865:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309940992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587120.171878:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587120.171912:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309940992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587120.171927:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788587120.171980:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309941120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587120.172096:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587120.172138:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309941120 00000100:00100000:2.0:1788587120.172142:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309941120 00000100:00100000:2.0:1788587120.172169:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788587120.172176:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309941120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587120.172202:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587120.172239:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309941120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587120.172246:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1788587120.172283:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2ce00 x1875469309940992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587120.172301:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309940992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587120.172334:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309941120:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788587120.172390:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788587120.172411:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2d180 x1875469309940864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587120.172429:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309940864:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788587120.327371:0:12960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788587120.683048:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309941248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587120.683122:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587120.683230:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309941248 00000100:00100000:2.0:1788587120.683237:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309941248 00000100:00100000:2.0:1788587120.683285:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788587120.683293:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309941248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587120.683330:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587120.683377:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309941248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587120.683383:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788587120.683842:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309941248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788587121.067265:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587122.090987:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587123.115220:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587123.756740:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309941504:0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.756836:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587123.756888:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309942016:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.756979:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309941376:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757015:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757040:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309941888:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757064:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757081:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309942400:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757099:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757114:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309942912:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757130:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757153:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788587123.757159:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309941760:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757180:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757197:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309942272:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757223:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757238:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309942784:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757257:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757327:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309941376 00000100:00100000:0.0:1788587123.757333:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309941376 00000100:00100000:0.0:1788587123.757384:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788587123.757393:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309941376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757437:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309941376:12345-0@lo:400:kworker.0 Request processed in 46us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587123.757444:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788587123.757484:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309942400 00000100:00100000:0.0:1788587123.757488:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309942400 00000100:00100000:0.0:1788587123.757513:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309942912 00000100:00100000:0.0:1788587123.757516:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309942912 00000100:00100000:0.0:1788587123.757526:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309942272 00000100:00100000:0.0:1788587123.757528:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309942272 00000100:00100000:0.0:1788587123.757553:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309942784 00000100:00100000:0.0:1788587123.757556:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309942784 00000100:00100000:3.0:1788587123.757558:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757568:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788587123.757574:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309942400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.757578:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309942528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.757599:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757603:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309942400:12345-0@lo:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587123.757608:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788587123.757617:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788587123.757619:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788587123.757622:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309941632:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757625:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309942912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.757643:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.757646:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309942912:12345-0@lo:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587123.757652:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788587123.757659:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309942144:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757662:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788587123.757667:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309942272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.757677:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587123.757688:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309942656:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.757688:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309942272:12345-0@lo:400:kworker.0 Request processed in 21us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587123.757973:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309941888 00000100:00100000:2.0:1788587123.757978:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309941888 00000100:00100000:2.0:1788587123.758000:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309941632 00000100:00100000:2.0:1788587123.758002:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309941632 00000100:00100000:2.0:1788587123.758017:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788587123.758023:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309941888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.758044:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587123.758055:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309941888:12345-0@lo:400:kworker.0 Request processed in 33us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587123.758061:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788587123.758067:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309941504 00000100:00100000:3.0:1788587123.758070:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309941504 00000100:00100000:2.0:1788587123.758072:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788587123.758077:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309941632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.758088:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309941760 00000100:00100000:3.0:1788587123.758098:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309941760 00000100:00100000:2.0:1788587123.758108:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309941632:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.758113:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309942016 00000100:00100000:2.0:1788587123.758114:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788587123.758115:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309942016 00000100:00100000:3.0:1788587123.758129:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309942528 00000100:00100000:3.0:1788587123.758131:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309942528 00000100:00100000:3.0:1788587123.758142:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309942144 00000100:00100000:3.0:1788587123.758144:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309942144 00000100:00100000:0.0:1788587123.758166:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788587123.758264:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309942656 00000100:00100000:3.0:1788587123.758268:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309942656 00000100:00100000:3.0:1788587123.758286:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788587123.758290:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309941504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.758320:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309941504:12345-0@lo:400:kworker.0 Request processed in 29us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.758325:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788587123.758334:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788587123.758339:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309941760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.758367:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309941760:12345-0@lo:400:kworker.0 Request processed in 27us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.758372:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788587123.758383:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788587123.758388:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309942016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.758410:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309942016:12345-0@lo:400:kworker.0 Request processed in 23us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.758416:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788587123.758425:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788587123.758429:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309942528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.758449:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309942528:12345-0@lo:400:kworker.0 Request processed in 20us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.758460:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788587123.758470:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788587123.758475:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309942144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.758499:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309942144:12345-0@lo:400:kworker.0 Request processed in 25us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.758504:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788587123.758513:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788587123.758518:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309942656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.758553:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309942656:12345-0@lo:400:kworker.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.759116:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1788587123.760362:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587123.760370:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587123.760373:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587123.760376:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587123.760431:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309941632:0@lo:400:kworker.0 00010000:00080000:3.0:1788587123.760448:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a51880 x1875469309942144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587123.760459:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309942144:0@lo:400:kworker.0 00010000:00080000:3.0:1788587123.760470:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a50000 x1875469309942656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587123.760479:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309942656:0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.760491:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309941504:0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.760501:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309942016:0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.760521:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309942528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.762632:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309941760:0@lo:400:kworker.0 00010000:00080000:3.0:1788587123.762655:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a50e00 x1875469309942272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587123.762666:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309942272:0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.762678:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309941376:0@lo:400:kworker.0 00000100:00100000:3.0:1788587123.762689:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309941888:0@lo:400:kworker.0 00000100:00100000:2.0:1788587123.766355:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788587123.766381:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309942784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587123.766476:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309942784:12345-0@lo:400:kworker.0 Request processed in 107us (9217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587123.766484:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1788587123.770015:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a50a80 x1875469309942400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587123.770036:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309942400:0@lo:400:kworker.0 00010000:00080000:2.0:1788587123.770052:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a53b80 x1875469309942912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587123.770060:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309942912:0@lo:400:kworker.0 00010000:00080000:2.0:1788587123.770134:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a51500 x1875469309942784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587123.770143:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309942784:0@lo:400:kworker.0 00000001:02000400:1.0:1788587123.870671:0:13061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:45:22 (1788587122) === 00000100:00100000:0.0:1788587124.099314:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.099359:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587124.099457:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292031872 00000100:00100000:1.0:1788587124.099468:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292031872 00000100:00100000:1.0:1788587124.099551:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:1.0:1788587124.099563:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:12266002-a8db-4050-aa6c-b9db12e6128d+6:10638:x1875469292031872:12345-192.168.203.14@tcp:700:mkdir.0 00000100:00100000:1.0:1788587124.099641:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:12266002-a8db-4050-aa6c-b9db12e6128d+6:10638:x1875469292031872:12345-192.168.203.14@tcp:700:mkdir.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587124.099649:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788587124.099717:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292031744 00000100:00100000:3.0:1788587124.099722:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292031744 00000100:00100000:3.0:1788587124.099758:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:3.0:1788587124.099766:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292031744:12345-192.168.203.14@tcp:41:mkdir.0 00000004:00000024:3.0:1788587124.099837:0:6472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587124.099895:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292031744:12345-192.168.203.14@tcp:41:mkdir.0 Request processed in 129us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.099902:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00080000:0.0:1788587124.100125:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587124.103389:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.107134:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292032128 00000100:00100000:0.0:1788587124.107151:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292032128 00000100:00100000:0.0:1788587124.107312:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:0.0:1788587124.107323:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:10638:x1875469292032128:12345-192.168.203.14@tcp:36:mkdir.0 00010000:00010000:0.0:1788587124.107382:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587124.107470:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f634384d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd570a expref: 6 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.107493:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76400) 00010000:00010000:0.0:1788587124.107518:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587124.107909:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.107924:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.107946:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.107975:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.107984:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.107991:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109128:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109141:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109164:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587124.109178:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6ae4ba8 reply state 0000000075115370 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109189:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109195:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587124.109203:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587124.109207:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788587124.109213:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788587124.109221:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109228:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109234:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109241:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587124.109246:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109254:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109264:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587124.109267:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587124.109277:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109283:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587124.109300:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6ae4ba8 reply state 0000000075115370 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109308:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.109313:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbf2c8be800) 00010000:00010000:0.0:1788587124.109316:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587124.109318:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788587124.109412:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:10638:x1875469292032128:12345-192.168.203.14@tcp:36:mkdir.0 Request processed in 2087us (6028us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788587124.109420:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:3.0:1788587124.127161:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.127558:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292032256 00000100:00100000:0.0:1788587124.127569:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292032256 00000100:00100000:0.0:1788587124.127626:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:0.0:1788587124.127636:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:10639:x1875469292032256:12345-192.168.203.14@tcp:101:chmod.0 00010000:00010000:0.0:1788587124.127655:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587124.127679:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd579d expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.127743:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.127758:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.127787:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587124.127864:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587124.127868:0:6472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587124.127906:0:6472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.127932:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd579d expref: 9 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.127952:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd579d expref: 8 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.127960:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587124.127963:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587124.127967:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482a00, rc 0) 00000100:00100000:0.0:1788587124.128032:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:10639:x1875469292032256:12345-192.168.203.14@tcp:101:chmod.0 Request processed in 396us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587124.128039:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:3.0:1788587124.131403:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.131774:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292032512 00000100:00100000:2.0:1788587124.131785:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292032512 00000100:00100000:2.0:1788587124.131855:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:2.0:1788587124.131865:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+8:10639:x1875469292032512:12345-192.168.203.14@tcp:36:chmod.0 00010000:00010000:2.0:1788587124.131920:0:8126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587124.131947:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd579d expref: 8 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.131968:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587124.131979:0:8126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587124.132005:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.132018:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.132029:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587124.132344:0:8126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fb655b9 reply state 0000000088fb0bd2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.132358:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.132365:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf03491400) 00010000:00010000:2.0:1788587124.132373:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788587124.132376:0:8126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788587124.132384:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788587124.132482:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+9:10639:x1875469292032512:12345-192.168.203.14@tcp:36:chmod.0 Request processed in 617us (1086us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788587124.132491:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00010000:00010000:3.0:1788587124.138978:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587124.152281:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587124.152465:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292032640 00000100:00100000:3.0:1788587124.152477:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292032640 00000100:00100000:3.0:1788587124.152560:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788587124.152570:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:10640:x1875469292032640:12345-192.168.203.14@tcp:101:chown.0 00010000:00010000:3.0:1788587124.152615:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587124.152635:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63439d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.152704:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63439dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.152718:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63439dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.152729:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63439dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587124.152762:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587124.152765:0:6472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587124.152837:0:6472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63439dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.152866:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63439d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57a4 expref: 11 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.152886:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63439dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57a4 expref: 10 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.152894:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf03491400) 00010000:00010000:3.0:1788587124.152897:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587124.152901:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105000, rc 0) 00000100:00100000:3.0:1788587124.152952:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+10:10640:x1875469292032640:12345-192.168.203.14@tcp:101:chown.0 Request processed in 382us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.152959:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788587124.156834:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.156921:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292032768 00000100:00100000:0.0:1788587124.157010:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292032768 00000100:00100000:0.0:1788587124.157074:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:0.0:1788587124.157085:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+10:10640:x1875469292032768:12345-192.168.203.14@tcp:101:chown.0 00010000:00010000:0.0:1788587124.157105:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587124.157125:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57ab expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157425:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157441:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157453:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157464:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157470:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157476:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157579:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f63439f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157587:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f63439f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157594:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f63439f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587124.157623:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587124.157627:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587124.157648:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f63439f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157670:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157677:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157683:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157689:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587124.157693:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157701:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157714:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf03491400) 00010000:00010000:0.0:1788587124.157716:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587124.157722:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157728:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63439ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157742:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157749:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157756:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157766:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587124.157769:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157775:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157783:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbf2c8be800) 00010000:00010000:0.0:1788587124.157785:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587124.157789:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157831:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f63439f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157862:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63439e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ab expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157875:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f63439f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ab expref: 11 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.157882:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587124.157884:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587124.157886:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482e00, rc 0) 00000100:00100000:0.0:1788587124.158416:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+11:10640:x1875469292032768:12345-192.168.203.14@tcp:101:chown.0 Request processed in 1331us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587124.158426:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:0.0:1788587124.165942:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.166049:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292032896 00000100:00100000:2.0:1788587124.166060:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292032896 00000100:00100000:2.0:1788587124.166110:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788587124.166120:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:12266002-a8db-4050-aa6c-b9db12e6128d+11:10640:x1875469292032896:12345-192.168.203.14@tcp:900:chown.0 00000100:00100000:2.0:1788587124.166208:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:12266002-a8db-4050-aa6c-b9db12e6128d+11:10640:x1875469292032896:12345-192.168.203.14@tcp:900:chown.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587124.166215:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:3.0:1788587124.169107:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.169344:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292033152 00000100:00100000:0.0:1788587124.169364:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292033152 00000100:00100000:0.0:1788587124.169431:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:0.0:1788587124.169440:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+11:10640:x1875469292033152:12345-192.168.203.14@tcp:36:chown.0 00010000:00010000:0.0:1788587124.169496:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587124.169523:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f63439f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ab expref: 11 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.169554:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587124.169559:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587124.169581:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.169594:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.169603:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587124.212010:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b55cc422 reply state 00000000e2c05f80 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.212037:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.212047:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587124.212051:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788587124.212055:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788587124.212070:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788587124.212168:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+12:10640:x1875469292033152:12345-192.168.203.14@tcp:36:chown.0 Request processed in 42725us (43066us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788587124.212197:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000001:00080000:1.0:1788587124.213119:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1788587124.213758:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213771:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213779:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213785:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587124.213789:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213818:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213832:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbf2c8be800) 00010000:00010000:2.0:1788587124.213854:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587124.213860:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213866:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f63439b2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213890:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213897:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213903:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213908:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587124.213911:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213916:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213924:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587124.213926:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587124.213929:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213935:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f63439b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213957:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213974:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213980:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213986:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587124.213989:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.213995:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214003:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf03491400) 00010000:00010000:2.0:1788587124.214005:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587124.214008:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214014:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63439ce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214025:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214030:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214036:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214040:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587124.214048:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214053:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214060:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587124.214063:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587124.214065:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.214071:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63439ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587124.233707:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.234068:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292033280 00000100:00100000:2.0:1788587124.234078:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292033280 00000100:00100000:2.0:1788587124.234171:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:2.0:1788587124.234181:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:10641:x1875469292033280:12345-192.168.203.14@tcp:101:touch.500 00010000:00010000:2.0:1788587124.234205:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587124.234225:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343a06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57b2 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587124.235682:0:8126:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1408us 00010000:00010000:0.0:1788587124.248621:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.248645:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.248657:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.248674:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.248682:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.248688:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249034:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249043:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249050:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587124.249070:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587124.249073:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587124.249117:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249129:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249135:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249142:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249147:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587124.249152:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249160:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249172:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf03491400) 00010000:00010000:0.0:1788587124.249174:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587124.249178:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249185:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249196:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249202:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249218:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249222:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587124.249225:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249230:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249238:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbf2c8be600) 00010000:00010000:0.0:1788587124.249240:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587124.249242:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249247:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343a14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249283:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343a06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57b2 expref: 8 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249299:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57b2 expref: 7 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.249305:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:0.0:1788587124.249307:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587124.249309:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482a00, rc 0) 00000100:00100000:0.0:1788587124.249384:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+7:10641:x1875469292033280:12345-192.168.203.14@tcp:101:touch.500 Request processed in 15203us (15686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587124.249402:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:3.0:1788587124.253715:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.253907:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292033536 00000100:00100000:0.0:1788587124.253918:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292033536 00000100:00100000:0.0:1788587124.253981:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:0.0:1788587124.253993:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:10641:x1875469292033536:12345-192.168.203.14@tcp:101:touch.500 00010000:00010000:0.0:1788587124.254016:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587124.254037:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343a22 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57b9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.254299:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.254314:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.254327:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.254341:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.254349:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.254355:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587124.255712:0:6474:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788587124.258763:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343a37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259100:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259115:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259157:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259165:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259172:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259178:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587124.259182:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259188:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259200:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:0.0:1788587124.259203:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587124.259207:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259214:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343a29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587124.259227:0:6474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b336e8ff reply state 000000005a0ce46c transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259245:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259252:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7aff7fc (ffff8cbf2c8be300) 00010000:00010000:0.0:1788587124.259254:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587124.259257:0:6474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788587124.259296:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343a22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57b9 expref: 10 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259313:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57b9 expref: 9 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.259320:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587124.259323:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587124.259325:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482c00, rc 0) 00000100:00100000:0.0:1788587124.259579:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+10:10641:x1875469292033536:12345-192.168.203.14@tcp:101:touch.500 Request processed in 5586us (5871us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788587124.259589:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:3.0:1788587124.263840:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.263963:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292033792 00000100:00100000:0.0:1788587124.263973:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292033792 00000100:00100000:0.0:1788587124.264032:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:0.0:1788587124.264041:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+10:10641:x1875469292033792:12345-192.168.203.14@tcp:36:touch.500 00010000:00010000:0.0:1788587124.264096:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587124.264121:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343a37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57b9 expref: 10 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.264139:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587124.264163:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587124.264204:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.264216:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.264227:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587124.264355:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e10699c1 reply state 0000000041a4f9e4 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.264367:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.264373:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be500) 00010000:00010000:0.0:1788587124.264375:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587124.264378:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587124.264476:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+11:10641:x1875469292033792:12345-192.168.203.14@tcp:36:touch.500 Request processed in 435us (644us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788587124.264485:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:2.0:1788587124.267017:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309943040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587124.267088:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587124.267847:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309943040 00000100:00100000:2.0:1788587124.267856:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309943040 00000100:00100000:2.0:1788587124.267898:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788587124.267968:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309943040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587124.268121:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587124.268133:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309943168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587124.268175:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788587124.268190:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587124.268214:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309943168 00000100:00100000:3.0:1788587124.268219:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309943168 00000100:00100000:3.0:1788587124.268241:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788587124.268247:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309943168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587124.268258:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587124.268294:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309943168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.268301:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788587124.268331:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309943040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 365us (1242us total) trans 0 rc 0/0 00010000:00080000:3.0:1788587124.268341:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372d180 x1875469309943168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587124.268357:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309943168:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788587124.268370:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9c700 x1875469309943040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587124.268379:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309943040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587124.268398:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788587124.268557:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.268595:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292033920 00000100:00100000:2.0:1788587124.268599:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292033920 00000100:00100000:2.0:1788587124.268677:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:2.0:1788587124.268686:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+11:10641:x1875469292033920:12345-192.168.203.14@tcp:101:touch.500 00010000:00010000:2.0:1788587124.268701:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587124.268720:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343a4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57c0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.268772:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343a4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57c0 expref: 12 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.268787:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343a4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57c0 expref: 12 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.268821:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be500) 00010000:00010000:2.0:1788587124.268825:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587124.268829:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044c00, rc 0) 00000100:00100000:2.0:1788587124.268864:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+12:10641:x1875469292033920:12345-192.168.203.14@tcp:101:touch.500 Request processed in 180us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587124.268870:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:2.0:1788587124.272752:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587124.272900:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292034048 00000100:00100000:3.0:1788587124.272911:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292034048 00000100:00100000:3.0:1788587124.272976:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:3.0:1788587124.272984:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2408:x1875469292034048:12345-192.168.203.14@tcp:8:touch.500 00010000:00080000:3.0:1788587124.273016:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:3.0:1788587124.273044:0:8449:0:(genops.c:1385:class_connect()) connect: client 12266002-a8db-4050-aa6c-b9db12e6128d, cookie 0x419e1ae1f6343a53 00002000:00100000:3.0:1788587124.273054:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 12266002-a8db-4050-aa6c-b9db12e6128d/ffff8cbf04938000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587124.273074:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587124.273261:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587124.273292:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8cbf0493d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587124.273350:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2408:x1875469292034048:12345-192.168.203.14@tcp:8:touch.500 Request processed in 366us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.273358:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:0.0:1788587124.276677:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587124.277033:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292034176 00000100:00100000:1.0:1788587124.277044:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292034176 00000100:00100000:1.0:1788587124.277144:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:1.0:1788587124.277154:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:0:x1875469292034176:12345-192.168.203.14@tcp:2:touch.500 00000100:00080000:0.0:1788587124.278165:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788587124.309538:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1788587124.309554:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000100:00100000:0.0:1788587124.309634:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:0:x1875469292034176:12345-192.168.203.14@tcp:2:touch.500 Request processed in 32476us (32960us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788587124.309646:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:2.0:1788587124.312518:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587124.312967:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292034432 00000100:00100000:1.0:1788587124.312978:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292034432 00000100:00100000:1.0:1788587124.313029:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:1.0:1788587124.313374:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+12:10641:x1875469292034432:12345-192.168.203.14@tcp:35:touch.500 00000100:00100000:0.0:1788587124.314478:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+13:10641:x1875469292034432:12345-192.168.203.14@tcp:35:touch.500 Request processed in 1434us (1962us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788587124.314489:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788587124.327493:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.327630:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292034560 00000100:00100000:0.0:1788587124.327642:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292034560 00000100:00100000:0.0:1788587124.327749:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:0.0:1788587124.327759:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+13:10642:x1875469292034560:12345-192.168.203.14@tcp:101:rm.0 00010000:00010000:0.0:1788587124.327782:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587124.327845:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343a5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57c7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.327983:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343a61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.327997:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.328010:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587124.328056:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587124.328060:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587124.328098:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.328127:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57c7 expref: 15 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.329430:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57c7 expref: 14 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.329444:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:0.0:1788587124.329447:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587124.329467:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483c00, rc 0) 00000100:00100000:2.0:1788587124.330584:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+14:10642:x1875469292034560:12345-192.168.203.14@tcp:101:rm.0 Request processed in 2820us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587124.330606:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:3.0:1788587124.338924:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587124.339027:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292034816 00000100:00100000:1.0:1788587124.339392:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292034816 00000100:00100000:1.0:1788587124.339455:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:1.0:1788587124.339465:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+14:10642:x1875469292034816:12345-192.168.203.14@tcp:101:rm.0 00010000:00010000:1.0:1788587124.339487:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587124.339511:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57ce expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587124.339610:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587124.340346:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343a68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ce expref: 16 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.340364:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf03491400) 00010000:00010000:1.0:1788587124.340368:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587124.340373:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ce expref: 16 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.340388:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc400, rc 0) 00000100:00100000:1.0:1788587124.340504:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+15:10642:x1875469292034816:12345-192.168.203.14@tcp:101:rm.0 Request processed in 1039us (1589us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1788587124.340513:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:0.0:1788587124.350736:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587124.351258:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292034944 00000100:00100000:1.0:1788587124.351282:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292034944 00000100:00100000:1.0:1788587124.351339:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587124.351350:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+15:10642:x1875469292034944:12345-192.168.203.14@tcp:37:rm.0 00000100:00100000:1.0:1788587124.358176:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+15:10642:x1875469292034944:12345-192.168.203.14@tcp:37:rm.0 Request processed in 6817us (7441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587124.358189:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:2.0:1788587124.364206:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.364646:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292035200 00000100:00100000:0.0:1788587124.364658:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292035200 00000100:00100000:0.0:1788587124.364731:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788587124.364742:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf11b74850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+15:10642:x1875469292035200:12345-192.168.203.14@tcp:35:rm.0 00000100:00100000:0.0:1788587124.365714:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf11b74850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+16:10642:x1875469292035200:12345-192.168.203.14@tcp:35:rm.0 Request processed in 969us (1511us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788587124.365724:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788587124.370492:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587124.370622:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292035456 00000100:00100000:3.0:1788587124.370632:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292035456 00000100:00100000:3.0:1788587124.370694:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:3.0:1788587124.370704:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+16:10642:x1875469292035456:12345-192.168.203.14@tcp:101:rm.0 00010000:00010000:2.0:1788587124.371032:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587124.371057:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343a76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57d5 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.371149:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343a7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.371175:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343a7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.371186:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343a7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587124.371197:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587124.371327:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343a76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57d5 expref: 19 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.371346:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343a7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57d5 expref: 18 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.371354:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:2.0:1788587124.371357:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587124.371360:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045800, rc 0) 00000100:00100000:2.0:1788587124.371522:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+18:10642:x1875469292035456:12345-192.168.203.14@tcp:101:rm.0 Request processed in 818us (1039us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788587124.371538:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:2.0:1788587124.375322:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587124.375477:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292035584 00000100:00100000:3.0:1788587124.375487:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292035584 00000100:00100000:3.0:1788587124.375592:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:3.0:1788587124.375603:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:10642:x1875469292035584:12345-192.168.203.14@tcp:41:rm.0 00000004:00000024:3.0:1788587124.375665:0:6472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788587124.375750:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:10642:x1875469292035584:12345-192.168.203.14@tcp:41:rm.0 Request processed in 140us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.375769:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:0.0:1788587124.378674:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.378715:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292035712 00000100:00100000:2.0:1788587124.378724:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292035712 00000100:00100000:2.0:1788587124.378789:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:2.0:1788587124.378831:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+18:10642:x1875469292035712:12345-192.168.203.14@tcp:101:rm.0 00010000:00010000:2.0:1788587124.378850:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587124.378869:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343a8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57dc expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.378934:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.378949:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.378961:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.378972:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.378979:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.378985:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379121:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031a00/0x419e1ae1f6343aa0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379131:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031a00/0x419e1ae1f6343aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379146:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031a00/0x419e1ae1f6343aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587124.379172:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788587124.379175:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587124.379191:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031a00/0x419e1ae1f6343aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379201:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031a00/0x419e1ae1f6343aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379208:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379215:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379222:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379227:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00030200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587124.379231:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379238:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379248:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:2.0:1788587124.379251:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587124.379255:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379270:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00030200/0x419e1ae1f6343a92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379284:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379290:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379295:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379300:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587124.379303:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379309:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379316:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7aff7fc (ffff8cbf2c8be300) 00010000:00010000:2.0:1788587124.379319:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587124.379322:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379328:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031600/0x419e1ae1f6343a99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379356:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343a8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57dc expref: 20 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379370:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031a00/0x419e1ae1f6343aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57dc expref: 19 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.379382:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be500) 00010000:00010000:2.0:1788587124.379384:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587124.379387:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00031a00, rc 0) 00000100:00100000:2.0:1788587124.379453:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:10642:x1875469292035712:12345-192.168.203.14@tcp:101:rm.0 Request processed in 625us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587124.379460:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:0.0:1788587124.385922:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587124.386064:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292035968 00000100:00100000:1.0:1788587124.386075:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292035968 00000100:00100000:1.0:1788587124.386134:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788587124.386144:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+19:10642:x1875469292035968:12345-192.168.203.14@tcp:36:rm.0 00010000:00010000:1.0:1788587124.386196:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788587124.386223:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031a00/0x419e1ae1f6343aa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57dc expref: 19 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386247:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343a4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57c0 expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386259:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be500) 00010000:00010000:1.0:1788587124.386268:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343a61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57c7 expref: 17 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386277:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:1.0:1788587124.386280:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587124.386302:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386316:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386341:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386355:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386363:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386369:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386469:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386477:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.386484:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587124.387380:0:6474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788587124.387391:0:6474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322136596353ns, next at 323136594194ns, rc = 0 00010000:00010000:1.0:1788587124.387448:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.387460:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.387470:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.387489:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.387495:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.387502:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390623:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587124.390670:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390683:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390690:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390697:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587124.390701:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390709:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390724:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be500) 00010000:00010000:1.0:1788587124.390727:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788587124.390732:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390758:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343ab5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390783:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390789:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390816:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390821:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587124.390825:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390831:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390840:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:1.0:1788587124.390842:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587124.390846:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390851:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343aa7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587124.390862:0:6474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af899748 reply state 00000000f8045734 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390873:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587124.390887:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7aff7fc (ffff8cbf2c8be300) 00010000:00010000:1.0:1788587124.390889:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587124.390892:0:6474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587124.390983:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+18:10642:x1875469292035968:12345-192.168.203.14@tcp:36:rm.0 Request processed in 4836us (5066us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788587124.390992:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00010000:00010000:2.0:1788587124.392251:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587124.392261:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.392271:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cda00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587124.392275:0:6461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.392285:0:6461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.392300:0:6461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be500) 00010000:00010000:2.0:1788587124.392303:0:6461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587124.392307:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.392314:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cda00/0x419e1ae1f6343abc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587124.392330:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587124.392332:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587124.392333:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587124.403134:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.403224:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292036224 00000100:00100000:2.0:1788587124.403252:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292036224 00000100:00100000:2.0:1788587124.403307:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788587124.403317:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:10642:x1875469292036224:12345-192.168.203.14@tcp:35:rm.0 00000100:00100000:2.0:1788587124.403561:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+19:10642:x1875469292036224:12345-192.168.203.14@tcp:35:rm.0 Request processed in 244us (437us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788587124.403568:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:3.0:1788587124.405904:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.406223:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292036480 00000100:00100000:0.0:1788587124.406233:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292036480 00000100:00100000:0.0:1788587124.406288:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:0.0:1788587124.406299:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+19:10642:x1875469292036480:12345-192.168.203.14@tcp:36:rm.0 00010000:00010000:0.0:1788587124.406356:0:8126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788587124.406381:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343a7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57d5 expref: 19 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.406403:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343a1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57b2 expref: 18 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.406426:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:0.0:1788587124.406442:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63439dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57a4 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.406477:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf03491400) 00010000:00010000:0.0:1788587124.406485:0:8126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587124.406508:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.406520:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.406540:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.406555:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.406562:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.406569:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407021:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407032:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407039:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587124.407589:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788587124.407605:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407620:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407627:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407634:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587124.407639:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407647:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407658:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587124.407661:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788587124.407664:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407671:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ad1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407689:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407695:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407700:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407705:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587124.407713:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407720:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.407729:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be200) 00010000:00010000:0.0:1788587124.407731:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587124.407734:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.408904:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ac3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587124.408925:0:8126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bdd3ce7 reply state 000000000ccbbc74 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.408939:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587124.408947:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbf2c8be000) 00010000:00010000:0.0:1788587124.408949:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587124.408953:0:8126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587124.409078:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+18:10642:x1875469292036480:12345-192.168.203.14@tcp:36:rm.0 Request processed in 2776us (3176us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788587124.409087:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788587124.888441:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587124.889681:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292036608 00000100:00100000:0.0:1788587124.889695:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292036608 00000100:00100000:0.0:1788587124.889766:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 333 00000100:00100000:0.0:1788587124.889776:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292036608:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587124.889888:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292036608:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 113us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587124.889912:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 333 00000100:00100000:2.0:1788587124.895922:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.895956:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.895996:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.896028:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587124.896055:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292037120 00000100:00100000:2.0:1788587124.896064:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292037120 00000100:00100000:2.0:1788587124.896116:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292036736 00000100:00100000:2.0:1788587124.896120:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292036736 00000100:00100000:2.0:1788587124.896134:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292036992 00000100:00100000:2.0:1788587124.896136:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292036992 00000100:00100000:2.0:1788587124.896152:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:2.0:1788587124.896161:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292037120:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587124.896232:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292037120:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587124.896239:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:2.0:1788587124.896254:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 194 00000100:00100000:2.0:1788587124.896260:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292036736:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587124.896286:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292036736:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587124.896291:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 194 00000100:00100000:2.0:1788587124.896318:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:2.0:1788587124.896324:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292036992:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587124.896363:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292036992:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587124.896369:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00080000:0.0:1788587124.896902:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587124.896907:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587124.897233:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292036864 00000100:00100000:3.0:1788587124.897240:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292036864 00000100:00100000:3.0:1788587124.897283:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:3.0:1788587124.897290:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292036864:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587124.897431:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292036864:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 141us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.897439:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 96 00010000:00010000:2.0:1788587125.162889:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587125.291380:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587125.291403:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309943296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587125.291472:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587125.291625:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309943296 00000100:00100000:3.0:1788587125.291634:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309943296 00000100:00100000:1.0:1788587125.291645:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587125.291656:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309943424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587125.291693:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788587125.291694:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587125.291709:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309943296:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587125.291732:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309943424 00000100:00100000:1.0:1788587125.291737:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309943424 00000100:00100000:1.0:1788587125.291763:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788587125.291770:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309943424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587125.291817:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587125.291867:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309943296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587125.291874:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1788587125.295912:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2c700 x1875469309943296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587125.295944:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309943296:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788587125.296143:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587125.296184:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309943552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587125.296251:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587125.296309:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309943552 00000100:00100000:0.0:1788587125.296315:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309943552 00000100:00100000:0.0:1788587125.296358:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788587125.296368:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309943552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587125.296406:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587125.296450:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309943552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.296456:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788587125.296488:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309943552:0@lo:41:osp-pre-0-1.0 00002000:00000024:1.0:1788587125.303764:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587125.303890:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309943424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12116us (12193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587125.303901:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1788587125.303969:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9ce00 x1875469309943424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587125.303993:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309943424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587125.802910:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309943680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587125.803001:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587125.803069:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309943680 00000100:00100000:3.0:1788587125.803075:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309943680 00000100:00100000:3.0:1788587125.803116:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788587125.803124:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309943680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587125.803162:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587125.803212:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309943680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587125.803218:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788587125.803260:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309943680:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587126.187026:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587127.211669:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587128.031572:0:13210:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788587128.235788:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587128.875040:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309943808:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.875055:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309944064:0@lo:400:kworker.0 00000100:00100000:2.0:1788587128.875122:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309943936:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877042:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587128.877107:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309944576:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877143:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587128.877164:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309945088:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877184:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587128.877211:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788587128.877218:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309944192:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877262:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587128.877282:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309944704:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877305:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587128.877322:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309945216:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877340:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587128.877381:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309944064 00000100:00100000:0.0:1788587128.877389:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309944064 00000100:00100000:0.0:1788587128.877430:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788587128.877438:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309944064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877492:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309944064:12345-0@lo:400:kworker.0 Request processed in 54us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.877514:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788587128.877542:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309944576 00000100:00100000:0.0:1788587128.877545:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309944576 00000100:00100000:0.0:1788587128.877573:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309945088 00000100:00100000:0.0:1788587128.877576:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309945088 00000100:00100000:0.0:1788587128.877589:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309944192 00000100:00100000:0.0:1788587128.877591:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309944192 00000100:00100000:0.0:1788587128.877603:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788587128.877609:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309944576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877639:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309944576:12345-0@lo:400:kworker.0 Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.877645:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788587128.877657:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788587128.877663:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309945088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.877689:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309945088:12345-0@lo:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.877704:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788587128.877717:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788587128.877723:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587128.877723:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309944192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587128.877753:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309944320:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.878087:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309944192:12345-0@lo:400:kworker.0 Request processed in 363us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.878094:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788587128.878117:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309944704 00000100:00100000:0.0:1788587128.878121:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309944704 00000100:00100000:0.0:1788587128.878149:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309945216 00000100:00100000:0.0:1788587128.878152:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309945216 00000100:00100000:0.0:1788587128.878171:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788587128.878177:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309944704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.878211:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309944704:12345-0@lo:400:kworker.0 Request processed in 35us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.878218:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788587128.878230:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788587128.878236:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309945216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.878577:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309945216:12345-0@lo:400:kworker.0 Request processed in 341us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.878585:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788587128.878606:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587128.878610:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587128.878613:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587128.878650:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309944192:0@lo:400:kworker.0 00010000:00080000:0.0:1788587128.878665:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a51880 x1875469309944704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587128.878689:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309944704:0@lo:400:kworker.0 00010000:00080000:0.0:1788587128.878702:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3418b100 x1875469309945216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587128.878711:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309945216:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.878721:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309944064:0@lo:400:kworker.0 00010000:00080000:0.0:1788587128.878730:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2aa00 x1875469309944576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587128.878737:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309944576:0@lo:400:kworker.0 00010000:00080000:0.0:1788587128.878747:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36a15500 x1875469309945088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587128.878769:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309945088:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.879325:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309943808 00000100:00100000:0.0:1788587128.879331:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309943808 00000100:00100000:0.0:1788587128.879363:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788587128.879369:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309943808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.879419:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309943808:12345-0@lo:400:kworker.0 Request processed in 50us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.879424:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788587128.880220:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587128.880264:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309944832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587128.880291:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587128.880318:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309945344:0@lo:400:kworker.0 00000100:00100000:1.0:1788587128.880338:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587128.880363:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309943808:0@lo:400:kworker.0 00000100:00100000:1.0:1788587128.880393:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309944832 00000100:00100000:1.0:1788587128.880397:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309944832 00000100:00100000:1.0:1788587128.880435:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309945344 00000100:00100000:1.0:1788587128.880438:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309945344 00000100:00100000:1.0:1788587128.880454:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788587128.880461:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309944832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587128.880571:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309944832:12345-0@lo:400:kworker.0 Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.880578:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788587128.880592:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788587128.880598:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309945344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587128.880624:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309945344:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.880630:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788587128.880645:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587128.880649:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587128.880666:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34188e00 x1875469309945344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587128.880675:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309945344:0@lo:400:kworker.0 00010000:00080000:1.0:1788587128.880683:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36a15f80 x1875469309944832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587128.880701:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309944832:0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.880965:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309944320 00000100:00100000:0.0:1788587128.880970:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309944320 00000100:00100000:0.0:1788587128.881067:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788587128.881076:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309944320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587128.881125:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309944320:12345-0@lo:400:kworker.0 Request processed in 51us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.881131:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788587128.881636:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587128.881666:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309943936 00000100:00100000:2.0:1788587128.881670:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309943936 00000100:00100000:2.0:1788587128.881699:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788587128.881707:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309943936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587128.881751:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309943936:12345-0@lo:400:kworker.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.881766:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788587128.881819:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309943936:0@lo:400:kworker.0 00000100:00100000:2.0:1788587128.881828:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309944448:0@lo:400:kworker.0 00000100:00100000:2.0:1788587128.881865:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587128.882065:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309944448 00000100:00100000:2.0:1788587128.882069:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309944448 00000100:00100000:2.0:1788587128.882102:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788587128.882110:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309944448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587128.882140:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309944448:12345-0@lo:400:kworker.0 Request processed in 32us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.882146:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1788587128.882161:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587128.882181:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309944448:0@lo:400:kworker.0 00000100:00100000:2.0:1788587128.882187:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309944960:0@lo:400:kworker.0 00000100:00100000:2.0:1788587128.882211:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587128.882230:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309944960 00000100:00100000:2.0:1788587128.882233:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309944960 00000100:00100000:2.0:1788587128.882274:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788587128.882280:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309944960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587128.882309:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309944960:12345-0@lo:400:kworker.0 Request processed in 30us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.882315:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:2.0:1788587128.882328:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587128.882341:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309944960:0@lo:400:kworker.0 00000100:00100000:1.0:1788587128.882345:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309944320:0@lo:400:kworker.0 00000020:00000080:2.0:1788587128.959756:0:13258:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc58712410 20000000:00000080:2.0:1788587128.959773:0:13258:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbe037a0400 uarg=0000000000000000 20000000:01000000:2.0:1788587128.959913:0:13258:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788587128.959920:0:13258:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788587128.959924:0:13258:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788587128.961961:0:13259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788587128.962678:0:13258:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788587128.968764:0:13258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788587128.968868:0:13258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788587128.968927:0:13258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788587128.968948:0:13258:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788587128.968968:0:13258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969053:0:13258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969065:0:13258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969074:0:13258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969080:0:13258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969086:0:13258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634398f expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969093:0:13258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634399d expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969100:0:13258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969148:0:13258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634399d expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969163:0:13258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634399d expref: 23 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.969177:0:13258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945472:0@lo:104: 00000100:00100000:0.0:1788587128.969336:0:13258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587128.969390:0:13258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634398f expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969399:0:13258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634398f expref: 23 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.969408:0:13258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945600:0@lo:104: 00010000:00010000:0.0:1788587128.969434:0:13258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969442:0:13258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 23 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.969450:0:13258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945728:0@lo:104: 00010000:00010000:0.0:1788587128.969474:0:13258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969480:0:13258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 23 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.969487:0:13258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945856:0@lo:104: 00010000:00010000:0.0:1788587128.969541:0:13258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969552:0:13258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 12 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.969562:0:13258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945984:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587128.969613:0:13258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.969621:0:13258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 12 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.969629:0:13258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309946112:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587128.969650:0:13258:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bc1a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587128.970077:0:6456:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788587128.970098:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587128.970122:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587128.970139:0:6456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587128.970147:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309945472 00000100:00100000:2.0:1788587128.970153:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309945472 00000100:00100000:2.0:1788587128.970187:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309945600 00000100:00100000:2.0:1788587128.970190:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309945600 00000100:00100000:2.0:1788587128.970199:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309945728 00000100:00100000:2.0:1788587128.970201:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309945728 00000100:00100000:2.0:1788587128.970209:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309945856 00000100:00100000:2.0:1788587128.970211:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309945856 00000100:00100000:2.0:1788587128.970224:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587128.970232:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a48850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+6:13258:x1875469309945472:12345-0@lo:104: 00010000:00010000:2.0:1788587128.970245:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970296:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587128.970302:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a48850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+6:13258:x1875469309945472:12345-0@lo:104: Request processed in 71us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.970309:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587128.970347:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587128.970353:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+5:13258:x1875469309945600:12345-0@lo:104: 00010000:00010000:2.0:1788587128.970361:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970391:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587128.970396:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+5:13258:x1875469309945600:12345-0@lo:104: Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.970413:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587128.970426:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587128.970432:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:13258:x1875469309945728:12345-0@lo:104: 00010000:00010000:2.0:1788587128.970440:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970473:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788587128.970478:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+4:13258:x1875469309945728:12345-0@lo:104: Request processed in 47us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.970483:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587128.970494:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587128.970511:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:13258:x1875469309945856:12345-0@lo:104: 00010000:00010000:2.0:1788587128.970519:0:6456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970548:0:6456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788587128.970553:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5a87955-d364-4ecd-b672-456c35aa135f+3:13258:x1875469309945856:12345-0@lo:104: Request processed in 44us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.970559:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788587128.970578:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788587128.970583:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970590:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587128.970594:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970612:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587128.970620:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587128.970625:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587128.970650:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970657:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587128.970676:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970684:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f634399d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63439a4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970698:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587128.970701:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970706:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cca00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587128.970709:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970716:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587128.970723:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587128.970734:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587128.970749:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970755:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587128.970770:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970777:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cca00/0x419e1ae1f634398f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343996 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970786:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587128.970789:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970814:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587128.970818:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970824:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587128.970830:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587128.970836:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587128.970848:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970854:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587128.970866:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970871:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482000/0x419e1ae1f6343981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6343988 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970879:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587128.970882:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970887:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587128.970889:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970895:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587128.970900:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587128.970904:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587128.970916:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970921:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587128.970926:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970933:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37105a00/0x419e1ae1f6343973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634397a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.970944:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587128.970951:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587128.970953:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587128.970960:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587128.970964:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587128.970969:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587128.970980:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309946240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587128.971874:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309946368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587128.971926:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587128.971968:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587128.971975:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309946496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587128.972005:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587128.972029:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309946624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587128.972050:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587128.972076:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309946368 00000100:00100000:3.0:1788587128.972081:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309946368 00010000:00010000:3.0:1788587128.972111:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634398f expref: 24 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.972130:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309946496 00000100:00100000:3.0:1788587128.972133:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309946496 00010000:00010000:3.0:1788587128.972145:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 25 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.972154:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309946624 00000100:00100000:3.0:1788587128.972156:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309946624 00010000:00010000:3.0:1788587128.972163:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 26 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.972175:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788587128.972182:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+26:3474:x1875469309946368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.972205:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587128.972210:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634398f expref: 26 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.972219:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634398f expref: 26 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.972236:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.972268:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+26:3474:x1875469309946368:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.972275:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788587128.972290:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788587128.972296:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+25:3474:x1875469309946496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.972303:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587128.972308:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 25 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.972315:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 25 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.972324:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.972345:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+25:3474:x1875469309946496:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.972351:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788587128.972362:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587128.972368:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309946624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.972375:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587128.972379:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 24 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.972394:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 24 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.972404:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.972431:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309946624:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.972437:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587128.972474:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309946624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587128.972516:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309946496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587128.972524:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309946368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587128.974533:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587128.974627:0:13258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945472:0@lo:104: 00010000:00010000:3.0:1788587128.974640:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343996 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634398f expref: 23 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.974654:0:13258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945600:0@lo:104: 00010000:00010000:3.0:1788587128.974664:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343981 expref: 22 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.974672:0:13258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945728:0@lo:104: 00010000:00010000:3.0:1788587128.974682:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634397a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6343973 expref: 21 pid: 6464 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.974690:0:13258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945856:0@lo:104: 00000100:00100000:1.0:1788587128.974959:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309946240 00000100:00100000:1.0:1788587128.974966:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309946240 00010000:00010000:1.0:1788587128.975008:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634399d expref: 21 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.975037:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587128.975046:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+21:3473:x1875469309946240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587128.975058:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587128.975063:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634399d expref: 21 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.975073:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634399d expref: 21 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.975089:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044000/0x419e1ae1f63439a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634399d expref: 21 pid: 6465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.975099:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587128.975137:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+20:3473:x1875469309946240:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.975145:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587128.975172:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309946240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587128.975450:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587128.975524:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587128.975543:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292037248 00000100:00100000:2.0:1788587128.975547:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292037248 00010000:00010000:2.0:1788587128.975567:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 13 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587128.975583:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292037376 00000100:00100000:2.0:1788587128.975586:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292037376 00010000:00010000:2.0:1788587128.975597:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 14 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587128.975609:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:2.0:1788587128.975616:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+14:2410:x1875469292037248:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587128.975624:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587128.975627:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 14 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975636:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 14 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975645:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587128.975679:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+14:2410:x1875469292037248:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 63us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.975700:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:2.0:1788587128.975720:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:2.0:1788587128.975727:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2410:x1875469292037376:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587128.975734:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587128.975739:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 13 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975749:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 13 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975760:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975768:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975781:0:6457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975788:0:6457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975816:0:6457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975822:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975828:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587128.975839:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975849:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975858:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.975867:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587128.975888:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2410:x1875469292037376:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 161us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.975894:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00010000:00010000:3.0:1788587128.976251:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37104600/0x419e1ae1f634396c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5796 expref: 12 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.976269:0:13258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309945984:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788587128.976283:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd578f expref: 11 pid: 6467 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.976292:0:13258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13258:1875469309946112:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788587128.976332:0:13258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.976342:0:13258:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.976348:0:13258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.976354:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6343ad8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.258905:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587129.391637:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf341baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309946752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587129.391734:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587129.391832:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf341b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309946880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587129.391936:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587129.391972:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309946752 00000100:00100000:3.0:1788587129.391979:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309946752 00000100:00100000:3.0:1788587129.392015:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309946880 00000100:00100000:3.0:1788587129.392018:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309946880 00000100:00100000:3.0:1788587129.392034:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788587129.392042:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309946752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587129.392085:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587129.392250:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309946752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 208us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587129.392258:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788587129.392266:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf341baa00 x1875469309946752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587129.392274:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788587129.392280:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309946880:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587129.392284:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf341baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309946752:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587129.392289:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587129.392391:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309946880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587129.392399:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788587129.392434:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf341b9500 x1875469309946880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587129.392447:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf341b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309946880:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788587129.496142:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788587129.496166:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788587129.496387:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496411:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496418:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496423:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587129.496428:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496436:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496452:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7aff7fc (ffff8cbf2c8be300) 00010000:00010000:1.0:1788587129.496455:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.496459:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496465:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343a30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496480:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496486:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496491:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496509:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587129.496517:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496522:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.496530:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cbf2c8be500) 00000100:00100000:2.0:1788587129.496931:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309947008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788587129.496996:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587129.497108:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.497113:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497120:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482200/0x419e1ae1f6343a45 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497142:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497149:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497155:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497160:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587129.497164:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497170:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497179:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7aff7fc (ffff8cbf2c8be300) 00010000:00010000:1.0:1788587129.497182:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.497193:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497199:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343aae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x7aff7fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497216:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497222:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497228:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497233:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587129.497236:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497242:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497249:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbf2c8be000) 00010000:00010000:1.0:1788587129.497252:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.497255:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497261:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343aca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.497286:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309947008 00000100:00100000:1.0:1788587129.497293:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309947008 00000100:00100000:1.0:1788587129.497334:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587129.497350:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309947008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788587129.497377:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788587129.497528:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9bac74, atime: 0x6a9bac74, ctime: 0x6a9bac74, blocks: 0x1 00010000:00010000:1.0:1788587129.497671:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497685:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1788587129.497690:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587129.497696:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497784:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497968:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.497977:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.498037:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788587129.498862:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469309947008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1512us (1863us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788587129.498873:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788587129.498927:0:3475:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe0586ed80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788587129.498934:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309947008:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788587129.500033:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587129.500043:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.500055:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587129.500059:0:8116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.500068:0:8116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.500101:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.500107:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343adf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.500193:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587129.500201:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587129.500203:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587129.796358:0:13309:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc03b123b0 20000000:00000080:3.0:1788587129.796376:0:13309:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbf3bd54c00 uarg=0000000000000000 20000000:01000000:3.0:1788587129.796408:0:13309:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788587129.796414:0:13309:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788587129.796419:0:13309:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788587129.798262:0:13310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788587129.798487:0:13309:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788587129.799103:0:13309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788587129.799156:0:13309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788587129.799209:0:13309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788587129.799225:0:13309:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788587129.799245:0:13309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799262:0:13309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799272:0:13309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799279:0:13309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799286:0:13309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799293:0:13309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799311:0:13309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587129.799316:0:13309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799324:0:13309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799337:0:13309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799345:0:13309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.799351:0:13309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343ae6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587130.005066:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587130.005108:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587130.005129:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587130.005145:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292037632 00000100:00100000:2.0:1788587130.005156:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292037632 00000100:00100000:3.0:1788587130.005161:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587130.005184:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587130.005209:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587130.005220:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292038144 00000100:00100000:2.0:1788587130.005225:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292038144 00000100:00100000:2.0:1788587130.005238:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292037760 00000100:00100000:2.0:1788587130.005240:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292037760 00000100:00100000:2.0:1788587130.005251:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292038016 00000100:00100000:2.0:1788587130.005254:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292038016 00000100:00100000:2.0:1788587130.005280:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 202 00000100:00100000:2.0:1788587130.005289:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292037632:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587130.005377:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292037632:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.005384:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 202 00000100:00100000:2.0:1788587130.005413:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 203 00000100:00100000:2.0:1788587130.005419:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292038144:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587130.005459:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292038144:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.005465:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 203 00000100:00100000:2.0:1788587130.005479:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 204 00000100:00100000:2.0:1788587130.005486:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292037760:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587130.005522:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292037760:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.005528:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 204 00000100:00100000:2.0:1788587130.005539:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 205 00000100:00100000:2.0:1788587130.005547:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292038016:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587130.005958:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292038016:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 410us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.005965:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 205 00000100:00100000:2.0:1788587130.006091:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292037504 00000100:00100000:2.0:1788587130.006096:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292037504 00000100:00100000:2.0:1788587130.006126:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 335 00000100:00100000:2.0:1788587130.006188:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:2412:x1875469292037504:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587130.006214:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:2412:x1875469292037504:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 82us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.006221:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 335 00000100:00080000:2.0:1788587130.006245:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587130.006249:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587130.008153:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292037888 00000100:00100000:1.0:1788587130.008169:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292037888 00000100:00100000:1.0:1788587130.008257:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:1.0:1788587130.008267:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292037888:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587130.008321:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292037888:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 56us (3213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.008328:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00080000:2.0:1788587130.008466:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788587130.282971:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587130.411349:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309947136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587130.411422:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.411543:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587130.411553:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309947264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587130.411582:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.412710:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309947392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587130.412753:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.412790:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309947392 00000100:00100000:2.0:1788587130.412812:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309947392 00000100:00100000:2.0:1788587130.412857:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788587130.412867:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309947392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587130.412906:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587130.412951:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309947392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.412958:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788587130.413023:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309947392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587130.417606:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309947136 00000100:00100000:1.0:1788587130.417621:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309947136 00000100:00100000:1.0:1788587130.417702:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309947264 00000100:00100000:1.0:1788587130.417705:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309947264 00000100:00100000:1.0:1788587130.417729:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788587130.417738:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309947136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587130.417775:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587130.417831:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788587130.417841:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309947264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587130.417851:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587130.417866:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309947136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (6446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.417873:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788587130.417879:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309947264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.417883:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788587130.418214:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587130.418274:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309947264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587130.418299:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309947136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587130.769909:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587130.769984:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292038272 00000100:00100000:0.0:1788587130.770009:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292038272 00000100:00100000:0.0:1788587130.770077:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 336 00000100:00100000:0.0:1788587130.770087:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:6383:x1875469292038272:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587130.770103:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587130.770121:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343aed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57e3 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.770148:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343aed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57e3 expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.770159:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343aed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57e3 expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.770168:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482200, rc 0) 00000100:00100000:0.0:1788587130.770230:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292038272:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.770236:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 336 00000100:00100000:3.0:1788587130.773175:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587130.773407:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292038400 00000100:00100000:2.0:1788587130.773416:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292038400 00000100:00100000:2.0:1788587130.773476:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 337 00000100:00100000:2.0:1788587130.773498:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292038400:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.774166:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292038400:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 679us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.774175:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 337 00000100:00100000:3.0:1788587130.777186:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587130.777353:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292038528 00000100:00100000:2.0:1788587130.777363:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292038528 00000100:00100000:2.0:1788587130.777428:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 338 00000100:00100000:2.0:1788587130.777438:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292038528:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.777664:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292038528:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 227us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.777673:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 338 00000100:00100000:1.0:1788587130.786421:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587130.786637:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292038656 00000100:00100000:2.0:1788587130.786647:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292038656 00000100:00100000:2.0:1788587130.786715:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 339 00000100:00100000:2.0:1788587130.786733:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:10926:x1875469292038656:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587130.787209:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:10926:x1875469292038656:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 481us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.787218:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 339 00000100:00100000:3.0:1788587130.797468:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587130.797633:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292038784 00000100:00100000:0.0:1788587130.797645:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292038784 00000100:00100000:0.0:1788587130.797733:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 340 00000100:00100000:0.0:1788587130.797744:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:10926:x1875469292038784:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587130.798203:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:10926:x1875469292038784:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 460us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.798213:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 340 00000100:00100000:3.0:1788587130.806368:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587130.806683:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292038912 00000100:00100000:2.0:1788587130.806693:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292038912 00000100:00100000:2.0:1788587130.806756:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 341 00000100:00100000:2.0:1788587130.806766:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:6383:x1875469292038912:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587130.806781:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587130.806821:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343af4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.806866:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ea expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.806879:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ea expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.806888:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00031600, rc 0) 00000100:00100000:2.0:1788587130.806956:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292038912:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 191us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.806963:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 341 00000100:00100000:1.0:1788587130.813112:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587130.813404:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292039040 00000100:00100000:0.0:1788587130.813414:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292039040 00000100:00100000:0.0:1788587130.813477:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 342 00000100:00100000:0.0:1788587130.813500:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292039040:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587130.814111:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292039040:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 623us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.814120:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 342 00000100:00100000:3.0:1788587130.818645:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587130.819222:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292039168 00000100:00100000:0.0:1788587130.819244:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292039168 00000100:00100000:0.0:1788587130.819308:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 343 00000100:00100000:0.0:1788587130.819318:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292039168:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587130.819555:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:6383:x1875469292039168:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 238us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.819563:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 343 00000100:00100000:3.0:1788587130.835306:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587130.835413:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292039296 00000100:00100000:2.0:1788587130.835423:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292039296 00000100:00100000:2.0:1788587130.835482:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 344 00000100:00100000:2.0:1788587130.835502:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:10929:x1875469292039296:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587130.835755:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:10929:x1875469292039296:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 254us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.835763:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 344 00000100:00100000:1.0:1788587130.843224:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587130.843561:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292039424 00000100:00100000:2.0:1788587130.843572:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292039424 00000100:00100000:2.0:1788587130.843633:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 345 00000100:00100000:2.0:1788587130.843642:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:10929:x1875469292039424:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587130.844060:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:10929:x1875469292039424:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 416us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.844070:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 345 00000100:00100000:0.0:1788587130.923601:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:3.0:1788587130.924217:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587130.924223:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe040c5800 from 7 10000000:01000000:3.0:1788587130.924227:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587130.924276:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.924288:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.924300:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587130.924322:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309947648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587130.924410:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587130.924462:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087fff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587130.924893:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309947648 00000100:00100000:1.0:1788587130.924902:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309947648 00000100:00100000:1.0:1788587130.924956:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788587130.924966:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+20:6469:x1875469309947648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587130.924978:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587130.925006:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343b02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343afb expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.925032:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343b02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343afb expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.925043:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343b02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343afb expref: 21 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.925053:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd400, rc 0) 00000100:00100000:1.0:1788587130.925111:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309947648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.925117:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788587130.925606:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309947648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587130.925626:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.925635:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587130.925713:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309947776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587130.925755:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587130.925828:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087fff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587130.925931:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309947776 00000100:00100000:2.0:1788587130.925942:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309947776 00000100:00100000:2.0:1788587130.925979:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788587130.925986:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309947776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.926241:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309947776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.926249:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788587130.926722:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309947520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587130.926764:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.927454:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309947520 00000100:00100000:2.0:1788587130.927462:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309947520 00000100:00100000:2.0:1788587130.927518:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788587130.927527:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309947520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587130.927566:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1788587130.927624:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309947520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.927632:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788587130.927730:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309947776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587130.927739:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309947520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587130.927782:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309947904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587130.928523:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587130.928560:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087fff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587130.928783:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309947904 00000100:00100000:2.0:1788587130.928790:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309947904 00000100:00100000:2.0:1788587130.928928:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788587130.928936:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309947904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.929136:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309947904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.929144:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788587130.929906:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309947904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587130.930949:0:13322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13322:1875469309948032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587130.931019:0:13322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587130.931061:0:13322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ffa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587130.931462:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309948032 00000100:00100000:1.0:1788587130.931468:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309948032 00000100:00100000:1.0:1788587130.931534:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788587130.931544:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:13322:x1875469309948032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587130.935180:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+21:13322:x1875469309948032:12345-0@lo:502:llog_process_th.0 Request processed in 3627us (4149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.935195:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788587130.936878:0:13322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13322:1875469309948032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587130.936925:0:13322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587130.936938:0:13322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587130.936940:0:13322:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587130.936948:0:13322:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe040c5800 00000020:00000080:3.0:1788587130.936951:0:13322:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587130.937019:0:13322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587130.937023:0:13322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587130.937025:0:13322:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587130.937028:0:13322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587130.937031:0:13322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587130.937033:0:13322:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788587130.937036:0:13322:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe040c5800 00000020:00000080:3.0:1788587130.937039:0:13322:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587130.937089:0:13322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13322:1875469309948160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587130.937156:0:13322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587130.937201:0:13322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587130.938531:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309948160 00000100:00100000:0.0:1788587130.938543:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309948160 00000100:00100000:0.0:1788587130.938619:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788587130.938630:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:13322:x1875469309948160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587130.939142:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+21:13322:x1875469309948160:12345-0@lo:502:llog_process_th.0 Request processed in 512us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.939151:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788587130.941127:0:13322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13322:1875469309948160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587130.941176:0:13322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587130.941185:0:13322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587130.941187:0:13322:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788587130.941192:0:13322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788587130.945807:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788587130.945843:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587130.945855:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.945868:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587130.945885:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587130.945888:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf3d10b000 from 7 10000000:01000000:2.0:1788587130.945891:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587130.945931:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.945940:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.945950:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587130.945975:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309948288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.946044:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.946086:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587130.946110:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309948288 00000100:00100000:2.0:1788587130.946116:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309948288 00000100:00100000:2.0:1788587130.946158:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788587130.946168:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+21:6469:x1875469309948288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587130.946181:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587130.946196:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf00030200/0x419e1ae1f6343b10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343b09 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.946220:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf00030200/0x419e1ae1f6343b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343b09 expref: 22 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.946230:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf00030200/0x419e1ae1f6343b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343b09 expref: 22 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.946250:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00030200, rc 0) 00000100:00100000:2.0:1788587130.946293:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309948288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.946299:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788587130.946347:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309948288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587130.946967:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.946979:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587130.947033:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309948416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.947068:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.947109:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587130.947292:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309948416 00000100:00100000:3.0:1788587130.947299:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309948416 00000100:00100000:3.0:1788587130.947335:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788587130.947355:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309948416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587130.947621:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309948416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587130.947629:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788587130.948713:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309948416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.948761:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309948544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.948975:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.949018:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587130.949321:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309948544 00000100:00100000:3.0:1788587130.949328:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309948544 00000100:00100000:3.0:1788587130.949391:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788587130.949401:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309948544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587130.949595:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309948544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587130.949603:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788587130.949884:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309948544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.959731:0:13324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13324:1875469309948672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587130.960080:0:13324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.960124:0:13324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587130.960183:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309948672 00000100:00100000:3.0:1788587130.960191:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309948672 00000100:00100000:3.0:1788587130.960246:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788587130.960256:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:13324:x1875469309948672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587130.960480:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:13324:x1875469309948672:12345-0@lo:502:llog_process_th.0 Request processed in 224us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587130.960498:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788587130.960643:0:13324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13324:1875469309948672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587130.960673:0:13324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587130.960682:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587130.960685:0:13324:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587130.960703:0:13324:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf3d10b000 00000020:00000080:1.0:1788587130.960706:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587130.960770:0:13324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587130.960774:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587130.960775:0:13324:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587130.960789:0:13324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587130.960826:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587130.960827:0:13324:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788587130.960832:0:13324:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf3d10b000 00000020:00000080:1.0:1788587130.960834:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788587130.960873:0:13324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13324:1875469309948800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587130.960909:0:13324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587130.960932:0:13324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587130.966181:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309948800 00000100:00100000:2.0:1788587130.966206:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309948800 00000100:00100000:2.0:1788587130.966277:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788587130.966287:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:13324:x1875469309948800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587130.966560:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+22:13324:x1875469309948800:12345-0@lo:502:llog_process_th.0 Request processed in 273us (5648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.966568:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000040:00080000:0.0:1788587130.967514:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788587130.967700:0:13324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13324:1875469309948800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587130.967830:0:13324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587130.967843:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587130.967846:0:13324:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788587130.967851:0:13324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788587130.967929:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788587130.967950:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587130.967960:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.967972:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587130.967981:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587130.967984:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf04818800 from 7 10000000:01000000:1.0:1788587130.967987:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587130.968019:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.968029:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.968038:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587130.968059:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309948928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.968109:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587130.968161:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a9780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587130.969330:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309948928 00000100:00100000:3.0:1788587130.969341:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309948928 00000100:00100000:3.0:1788587130.969392:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788587130.969402:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+22:6469:x1875469309948928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587130.969415:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587130.969430:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343b1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343b17 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.969457:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343b17 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.969469:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343b17 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.969477:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105e00, rc 0) 00000100:00100000:3.0:1788587130.969549:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309948928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587130.969555:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788587130.969654:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309948928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587130.969671:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.969680:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587130.971942:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.972014:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587130.972055:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a9780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587130.972077:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309949056 00000100:00100000:1.0:1788587130.972083:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309949056 00000100:00100000:1.0:1788587130.972122:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788587130.972130:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309949056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.974319:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309949056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2180us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.974331:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788587130.974396:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.974445:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.974508:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587130.974537:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a9780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587130.974555:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309949184 00000100:00100000:1.0:1788587130.974561:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309949184 00000100:00100000:1.0:1788587130.974591:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788587130.974599:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309949184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.974766:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309949184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.974774:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788587130.977647:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.978708:0:13328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13328:1875469309949312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587130.978780:0:13328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587130.979458:0:13328:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587130.981914:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309949312 00000100:00100000:0.0:1788587130.981930:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309949312 00000100:00100000:1.0:1788587130.982524:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788587130.982536:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:13328:x1875469309949312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587130.983460:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:13328:x1875469309949312:12345-0@lo:502:llog_process_th.0 Request processed in 923us (4676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.983470:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788587130.983711:0:13328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13328:1875469309949312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587130.983746:0:13328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587130.983757:0:13328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587130.983759:0:13328:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587130.983766:0:13328:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf04818800 00000020:00000080:0.0:1788587130.983769:0:13328:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587130.983971:0:13328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587130.983975:0:13328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587130.983977:0:13328:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587130.983980:0:13328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587130.983983:0:13328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587130.983984:0:13328:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788587130.983987:0:13328:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf04818800 00000020:00000080:0.0:1788587130.983990:0:13328:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788587130.984039:0:13328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13328:1875469309949440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587130.984090:0:13328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587130.984121:0:13328:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bc1a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587130.984688:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309949440 00000100:00100000:1.0:1788587130.984936:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309949440 00000100:00100000:1.0:1788587130.984979:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788587130.984988:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:13328:x1875469309949440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587130.985186:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+23:13328:x1875469309949440:12345-0@lo:502:llog_process_th.0 Request processed in 198us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.985193:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788587130.985674:0:13328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13328:1875469309949440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587130.985710:0:13328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587130.985717:0:13328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587130.985719:0:13328:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788587130.985724:0:13328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788587130.986330:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788587130.986349:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587130.986360:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.986371:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587130.986452:0:6469:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587130.986454:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf11802800 from 7 10000000:01000000:1.0:1788587130.986457:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587130.986502:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.986510:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.986519:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587130.986538:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.988224:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587130.988547:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f01000 going to sleep for 11 seconds 00000040:00080000:3.0:1788587130.991436:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587130.991921:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309949568 00000100:00100000:2.0:1788587130.991931:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309949568 00000100:00100000:3.0:1788587130.992693:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788587130.993265:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+23:6469:x1875469309949568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587130.993285:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587130.993302:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343b2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6343b25 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.993330:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6343b25 expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.993341:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6343b25 expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.993364:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37104200, rc 0) 00000100:00100000:3.0:1788587130.993459:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:6469:x1875469309949568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.993526:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587130.993545:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.993565:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587130.993633:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587130.993667:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587130.993703:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587130.995347:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309949696 00000100:00100000:0.0:1788587130.995370:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309949696 00000100:00100000:0.0:1788587130.995407:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788587130.995416:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+25:6469:x1875469309949696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587130.996665:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+25:6469:x1875469309949696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1244us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.996677:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788587130.997002:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05737800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.997057:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587130.997108:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587130.997151:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f01840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587130.997211:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309949824 00000100:00100000:0.0:1788587130.997217:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309949824 00000100:00100000:0.0:1788587130.997270:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788587130.997280:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+25:6469:x1875469309949824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587130.997450:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+25:6469:x1875469309949824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.997457:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788587130.997726:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5a87955-d364-4ecd-b672-456c35aa135f:6469:1875469309949824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587131.002345:0:13330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13330:1875469309949952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587131.002431:0:13330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587131.002469:0:13330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f01600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587131.002542:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309949952 00000100:00100000:0.0:1788587131.002550:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309949952 00000100:00100000:0.0:1788587131.002598:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788587131.002607:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+25:13330:x1875469309949952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587131.003936:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+25:13330:x1875469309949952:12345-0@lo:502:llog_process_th.0 Request processed in 1325us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587131.003949:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788587131.004051:0:13330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13330:1875469309949952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587131.004083:0:13330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587131.004101:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587131.004103:0:13330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587131.004110:0:13330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf11802800 00000020:00000080:1.0:1788587131.004112:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587131.004176:0:13330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587131.004179:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587131.004180:0:13330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587131.004183:0:13330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587131.004186:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587131.004187:0:13330:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788587131.004191:0:13330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf11802800 00000020:00000080:1.0:1788587131.004193:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587131.004605:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788587131.005454:0:13330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13330:1875469309950080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587131.005532:0:13330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587131.005574:0:13330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f01600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587131.005951:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309950080 00000100:00100000:2.0:1788587131.005959:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309950080 00000100:00100000:2.0:1788587131.006004:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788587131.006013:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:13330:x1875469309950080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587131.006357:0:13330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5a87955-d364-4ecd-b672-456c35aa135f:13330:1875469309950080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587131.006388:0:13330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587131.006395:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587131.006397:0:13330:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788587131.006402:0:13330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788587131.006726:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788587131.006754:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587131.006765:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587131.006775:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587131.007411:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:13330:x1875469309950080:12345-0@lo:502:llog_process_th.0 Request processed in 220us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587131.007422:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00010000:2.0:1788587131.307461:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587132.011488:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788587132.012552:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788587132.330963:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587133.355036:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587133.995288:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309950464:0@lo:400:kworker.0 00000100:00100000:0.0:1788587133.995342:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309950336:0@lo:400:kworker.0 00000100:00100000:1.0:1788587133.995368:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587133.995438:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309950464 00000100:00100000:3.0:1788587133.995447:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309950464 00000100:00100000:3.0:1788587133.995514:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788587133.995525:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309950464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587133.998122:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309950208:0@lo:400:kworker.0 00000100:00100000:0.0:1788587133.998439:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587133.998511:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309950848:0@lo:400:kworker.0 00000100:00100000:0.0:1788587133.999321:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587133.999358:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309951360:0@lo:400:kworker.0 00000100:00100000:0.0:1788587133.999384:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587133.999428:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309950336 00000100:00100000:0.0:1788587133.999435:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309950336 00000100:00100000:0.0:1788587133.999605:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309950848 00000100:00100000:0.0:1788587133.999609:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309950848 00000100:00100000:0.0:1788587133.999633:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309951360 00000100:00100000:0.0:1788587133.999636:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309951360 00000100:00100000:0.0:1788587133.999653:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788587133.999661:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309950336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587133.999842:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309950336:12345-0@lo:400:kworker.0 Request processed in 180us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587133.999849:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788587133.999865:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788587133.999870:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309950848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587133.999893:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309950848:12345-0@lo:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587133.999899:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788587133.999907:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788587133.999912:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309951360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587133.999945:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309951360:12345-0@lo:400:kworker.0 Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587133.999951:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1788587133.999971:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587134.000072:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309950336:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000084:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309950848:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000092:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309951360:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000243:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309950592:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000273:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587134.000298:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309951104:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000320:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587134.000338:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309951616:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000357:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587134.000375:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587134.000382:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309951488:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000401:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587134.000422:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309950592 00000100:00100000:0.0:1788587134.000425:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309950592 00000100:00100000:0.0:1788587134.000448:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309951488 00000100:00100000:0.0:1788587134.000450:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309951488 00000100:00100000:0.0:1788587134.000479:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788587134.000485:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309950592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000517:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309950592:12345-0@lo:400:kworker.0 Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587134.000523:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788587134.000650:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788587134.000658:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309951488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000690:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309951488:12345-0@lo:400:kworker.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587134.000771:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1788587134.000791:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788587134.000835:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0c700 x1875469309951488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587134.000846:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309951488:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000854:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309950592:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000885:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309951104 00000100:00100000:0.0:1788587134.000888:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309951104 00000100:00100000:0.0:1788587134.000914:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309951616 00000100:00100000:0.0:1788587134.000916:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309951616 00000100:00100000:0.0:1788587134.000929:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788587134.000934:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309951104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.000966:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309951104:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587134.000972:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788587134.000982:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788587134.000987:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309951616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.001011:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309951616:12345-0@lo:400:kworker.0 Request processed in 24us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587134.001017:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788587134.001029:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587134.001031:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587134.001053:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309951104:0@lo:400:kworker.0 00010000:00080000:0.0:1788587134.001063:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0d880 x1875469309951616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587134.001071:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309951616:0@lo:400:kworker.0 00000100:00100000:1.0:1788587134.001580:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309950976:0@lo:400:kworker.0 00000100:00100000:1.0:1788587134.001619:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587134.001857:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309950976 00000100:00100000:0.0:1788587134.001863:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309950976 00000100:00100000:0.0:1788587134.001897:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788587134.001903:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309950976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.001941:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309950976:12345-0@lo:400:kworker.0 Request processed in 38us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587134.001948:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1788587134.001972:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788587134.002007:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0f100 x1875469309950976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587134.002018:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309950976:0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.004598:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309950464:12345-0@lo:400:kworker.0 Request processed in 9063us (9219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587134.004613:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788587134.004711:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309950464:0@lo:400:kworker.0 00000100:00100000:2.0:1788587134.005098:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587134.005150:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309950720:0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.005170:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309950208 00000100:00100000:3.0:1788587134.005178:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309950208 00000100:00100000:2.0:1788587134.005188:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587134.005230:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788587134.005260:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309951232:0@lo:400:kworker.0 00000100:00100000:2.0:1788587134.005288:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587134.005315:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309951744:0@lo:400:kworker.0 00000100:00100000:2.0:1788587134.005335:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587134.005372:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309951232 00000100:00100000:2.0:1788587134.005376:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309951232 00000100:00100000:2.0:1788587134.005413:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309951744 00000100:00100000:2.0:1788587134.005416:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309951744 00000100:00100000:2.0:1788587134.005438:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587134.005444:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309951232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587134.005502:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309951232:12345-0@lo:400:kworker.0 Request processed in 58us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587134.005508:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587134.005521:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587134.005527:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309951744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587134.005553:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309951744:12345-0@lo:400:kworker.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587134.005559:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1788587134.005578:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587134.005581:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587134.005602:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309951232:0@lo:400:kworker.0 00010000:00080000:2.0:1788587134.005613:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0e300 x1875469309951744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587134.005636:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309951744:0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.005665:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309950208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.005716:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309950208:12345-0@lo:400:kworker.0 Request processed in 478us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587134.005723:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788587134.005833:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309950208:0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.006107:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309950720 00000100:00100000:0.0:1788587134.006113:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309950720 00000100:00100000:0.0:1788587134.006200:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788587134.006209:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309950720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.006290:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309950720:12345-0@lo:400:kworker.0 Request processed in 83us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587134.006297:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788587134.006361:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309950720:0@lo:400:kworker.0 00010000:00010000:2.0:1788587134.378952:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587134.508992:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587134.509017:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309952000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587134.509087:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587134.509182:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309952000 00000100:00100000:3.0:1788587134.509191:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309952000 00000100:00100000:3.0:1788587134.509235:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788587134.509244:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309952000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587134.509290:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587134.509334:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309952000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587134.509341:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1788587134.509381:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0fb80 x1875469309952000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587134.509398:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309952000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587134.514247:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587134.514272:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309951872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587134.514341:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587134.514420:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309951872 00000100:00100000:2.0:1788587134.514427:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309951872 00000100:00100000:2.0:1788587134.514483:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788587134.514493:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309951872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587134.514515:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587134.514555:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309951872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587134.514562:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788587134.514598:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0d500 x1875469309951872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587134.514629:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309951872:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788587134.616335:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1788587135.123042:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587135.123086:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587135.123118:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587135.123162:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587135.123182:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587135.123204:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587135.123445:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292039680 00000100:00100000:0.0:1788587135.123466:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292039680 00000100:00100000:0.0:1788587135.123527:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292040192 00000100:00100000:0.0:1788587135.123543:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292040192 00000100:00100000:0.0:1788587135.123561:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292039808 00000100:00100000:0.0:1788587135.123564:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292039808 00000100:00100000:0.0:1788587135.123575:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292040064 00000100:00100000:0.0:1788587135.123577:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292040064 00000100:00100000:0.0:1788587135.123593:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 212 00000100:00100000:0.0:1788587135.123602:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292039680:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587135.123688:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292039680:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 86us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587135.123695:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 212 00000100:00100000:0.0:1788587135.123712:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 213 00000100:00100000:0.0:1788587135.123718:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292040192:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587135.123743:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292040192:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 25us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587135.123748:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 213 00000100:00100000:0.0:1788587135.123760:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 214 00000100:00100000:0.0:1788587135.123765:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292039808:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587135.123786:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292039808:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 21us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587135.123791:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 214 00000100:00100000:0.0:1788587135.123891:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 215 00000100:00100000:0.0:1788587135.123898:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292040064:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587135.123920:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292040064:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587135.123926:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 215 00000100:00100000:2.0:1788587135.124439:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292039552 00000100:00100000:2.0:1788587135.124445:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292039552 00000100:00100000:2.0:1788587135.124501:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 367 00000100:00100000:2.0:1788587135.124508:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292039552:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587135.124550:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292039552:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 42us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587135.124564:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 367 00000100:00100000:2.0:1788587135.124596:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292039936 00000100:00100000:2.0:1788587135.124600:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292039936 00000100:00100000:2.0:1788587135.124629:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 106 00000100:00100000:2.0:1788587135.124636:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292039936:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587135.124664:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292039936:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587135.124670:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 106 00000100:00080000:3.0:1788587135.125314:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587135.125321:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587135.125324:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587135.404971:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587135.532009:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309952128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587135.532091:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587135.532130:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309952128 00000100:00100000:2.0:1788587135.532140:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309952128 00000100:00100000:2.0:1788587135.532191:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788587135.532200:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309952128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587135.532234:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587135.532290:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309952128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587135.532298:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788587135.532325:0:3475:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788587135.532331:0:3475:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe0586ed80, transno 4294967301 00000100:00100000:0.0:1788587135.532360:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309952128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587135.532406:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587135.532415:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309952256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587135.532444:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587135.534771:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309952256 00000100:00100000:1.0:1788587135.534783:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309952256 00000100:00100000:1.0:1788587135.534881:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788587135.534891:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309952256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587135.534927:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587135.534998:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309952384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587135.535044:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587135.535627:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309952256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 735us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587135.535635:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788587135.535710:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309952384 00000100:00100000:2.0:1788587135.535716:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309952384 00000100:00100000:2.0:1788587135.535750:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788587135.535759:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309952384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587135.535774:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587135.535844:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309952256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587135.535852:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309952384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587135.535860:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788587135.535880:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309952384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587136.043195:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587136.043217:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309952512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587136.043288:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587136.043412:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309952512 00000100:00100000:3.0:1788587136.043421:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309952512 00000100:00100000:3.0:1788587136.047679:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788587136.047705:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309952512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587136.047752:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587136.047871:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309952512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 178us (4583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587136.047880:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788587136.047983:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309952512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587136.426909:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587137.451070:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587138.475035:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587139.115103:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309952640:0@lo:400:kworker.0 00000100:00100000:0.0:1788587139.115174:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587139.115305:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309952640 00000100:00100000:1.0:1788587139.115313:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309952640 00000100:00100000:1.0:1788587139.115363:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788587139.115372:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309952640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.115514:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309952768:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.115552:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.115581:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587139.115588:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309952896:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.115614:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.115722:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309952896 00000100:00100000:2.0:1788587139.115727:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309952896 00000100:00100000:2.0:1788587139.115758:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788587139.115765:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309952896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.115826:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309952896:12345-0@lo:400:kworker.0 Request processed in 61us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587139.115833:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788587139.115869:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309952896:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.115903:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309953024:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.115938:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.115981:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309952768 00000100:00100000:2.0:1788587139.115984:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309952768 00000100:00100000:2.0:1788587139.116006:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309953024 00000100:00100000:2.0:1788587139.116008:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309953024 00000100:00100000:2.0:1788587139.118546:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788587139.118569:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309952768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.118661:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309952768:12345-0@lo:400:kworker.0 Request processed in 104us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587139.118668:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788587139.118686:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788587139.118706:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309953024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.118741:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309953024:12345-0@lo:400:kworker.0 Request processed in 37us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587139.118748:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788587139.118814:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309953024:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.118851:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309952768:0@lo:400:kworker.0 00000100:00100000:1.0:1788587139.119304:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309952640:12345-0@lo:400:kworker.0 Request processed in 3931us (4127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587139.119314:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788587139.119596:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309953280:0@lo:400:kworker.0 00000100:00100000:1.0:1788587139.119635:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587139.119701:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309953792:0@lo:400:kworker.0 00000100:00100000:1.0:1788587139.119725:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.119735:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309953408:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.119774:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309953536:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.119821:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.119844:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309954048:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.119874:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.119901:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788587139.119909:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309953152:0@lo:400:kworker.0 00000100:00100000:1.0:1788587139.119913:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309953536 00000100:00100000:1.0:1788587139.119922:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309953536 00000100:00100000:2.0:1788587139.119936:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.119960:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309953664:0@lo:400:kworker.0 00000100:00100000:1.0:1788587139.119969:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309954048 00000100:00100000:1.0:1788587139.119973:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309954048 00000100:00100000:2.0:1788587139.119989:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587139.119995:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309953664 00000100:00100000:1.0:1788587139.119998:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309953664 00000100:00100000:2.0:1788587139.120005:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309954176:0@lo:400:kworker.0 00000100:00100000:1.0:1788587139.120019:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788587139.120028:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309953536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.120036:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.120062:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309954176 00000100:00100000:2.0:1788587139.120067:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309954176 00000100:00100000:1.0:1788587139.120079:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309953536:12345-0@lo:400:kworker.0 Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587139.120092:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788587139.120100:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309954048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587139.120113:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788587139.120131:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788587139.120140:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309953664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.120146:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309954048:12345-0@lo:400:kworker.0 Request processed in 46us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587139.120163:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788587139.120178:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309953664:12345-0@lo:400:kworker.0 Request processed in 40us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587139.120184:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587139.120203:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788587139.120211:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309954176:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788587139.120216:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587139.120221:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587139.120245:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309954176:12345-0@lo:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587139.120251:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788587139.120277:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587139.120345:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309952640:0@lo:400:kworker.0 00000100:00100000:3.0:1788587139.120354:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309953280 00000100:00100000:3.0:1788587139.120359:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309953280 00000100:00080000:0.0:1788587139.120389:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587139.120396:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309953792 00000100:00100000:3.0:1788587139.120407:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309953792 00000100:00100000:0.0:1788587139.120420:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788587139.120439:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309953280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587139.120450:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788587139.120460:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309953792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587139.120486:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309953280:12345-0@lo:400:kworker.0 Request processed in 58us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587139.120502:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309953792:12345-0@lo:400:kworker.0 Request processed in 44us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587139.120503:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788587139.120513:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:0.0:1788587139.120526:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587139.120555:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309953280:0@lo:400:kworker.0 00000100:00100000:3.0:1788587139.120562:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309953664:0@lo:400:kworker.0 00000100:00100000:0.0:1788587139.120574:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309953792:0@lo:400:kworker.0 00010000:00080000:3.0:1788587139.120583:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41746680 x1875469309954176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587139.120593:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309954176:0@lo:400:kworker.0 00000100:00100000:3.0:1788587139.120604:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309953536:0@lo:400:kworker.0 00010000:00080000:3.0:1788587139.120612:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0e300 x1875469309954048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587139.120619:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309954048:0@lo:400:kworker.0 00000100:00100000:3.0:1788587139.120648:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309953152 00000100:00100000:3.0:1788587139.120651:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309953152 00000100:00100000:3.0:1788587139.120676:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788587139.120682:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309953152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587139.120718:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309953152:12345-0@lo:400:kworker.0 Request processed in 36us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587139.120724:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788587139.120746:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309953152:0@lo:400:kworker.0 00000100:00100000:2.0:1788587139.124009:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309953920:0@lo:400:kworker.0 00000100:00100000:0.0:1788587139.124199:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309953408 00000100:00100000:0.0:1788587139.124208:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309953408 00000100:00100000:0.0:1788587139.124303:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788587139.124313:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309953408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587139.124400:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309953408:12345-0@lo:400:kworker.0 Request processed in 88us (4121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587139.124408:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1788587139.124526:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587139.124591:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788587139.124640:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0dc00 x1875469309953408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587139.124653:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309953408:0@lo:400:kworker.0 00000100:00100000:0.0:1788587139.124824:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309953920 00000100:00100000:0.0:1788587139.124829:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309953920 00000100:00100000:0.0:1788587139.124875:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788587139.124881:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309953920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587139.124937:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309953920:12345-0@lo:400:kworker.0 Request processed in 56us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587139.124944:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00080000:3.0:1788587139.125002:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0d880 x1875469309953920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587139.125004:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587139.125036:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309953920:0@lo:400:kworker.0 00010000:00010000:2.0:1788587139.499180:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587139.629250:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587139.629271:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309954304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587139.629345:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587139.630639:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309954304 00000100:00100000:2.0:1788587139.630651:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309954304 00000100:00100000:2.0:1788587139.630700:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788587139.630710:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309954304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587139.630745:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587139.630825:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309954304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587139.630832:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788587139.630910:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309954432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587139.630940:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788587139.630982:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41746680 x1875469309954304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587139.630985:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309954432 00000100:00100000:1.0:1788587139.630988:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309954432 00000100:00100000:1.0:1788587139.631012:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788587139.631018:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309954432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587139.631019:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309954304:0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587139.631028:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587139.631062:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309954432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587139.631068:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788587139.631207:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34197480 x1875469309954432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587139.631219:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309954432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587140.247762:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587140.247871:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292040320 00000100:00100000:2.0:1788587140.247882:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292040320 00000100:00100000:2.0:1788587140.247936:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 369 00000100:00100000:2.0:1788587140.247945:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2410:x1875469292040320:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587140.248294:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2410:x1875469292040320:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 348us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587140.248303:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 369 00000100:00100000:3.0:1788587140.263134:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587140.263163:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587140.263184:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587140.263205:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587140.263228:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587140.263254:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292040448 00000100:00100000:3.0:1788587140.263264:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292040448 00000100:00100000:3.0:1788587140.263326:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292040576 00000100:00100000:3.0:1788587140.263329:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292040576 00000100:00100000:3.0:1788587140.263342:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292040832 00000100:00100000:3.0:1788587140.263344:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292040832 00000100:00100000:3.0:1788587140.263354:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292040960 00000100:00100000:3.0:1788587140.263357:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292040960 00000100:00100000:3.0:1788587140.263373:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 222 00000100:00100000:3.0:1788587140.263383:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292040448:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587140.263462:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292040448:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 81us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.263470:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 222 00000100:00100000:3.0:1788587140.263487:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 223 00000100:00100000:3.0:1788587140.263494:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292040576:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587140.263519:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292040576:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.263538:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 223 00000100:00100000:3.0:1788587140.263552:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 224 00000100:00100000:3.0:1788587140.263558:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292040832:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587140.263586:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292040832:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.263591:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 224 00000100:00100000:3.0:1788587140.263602:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 225 00000100:00100000:3.0:1788587140.263607:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292040960:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587140.263627:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292040960:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 19us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.263633:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 225 00000100:00100000:3.0:1788587140.263657:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292040704 00000100:00100000:3.0:1788587140.263660:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292040704 00000100:00100000:3.0:1788587140.263689:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00100000:3.0:1788587140.263696:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292040704:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587140.263721:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292040704:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.263727:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00080000:3.0:1788587140.263747:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587140.263751:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587140.263753:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587140.522978:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587140.651234:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587140.651255:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309954560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587140.651318:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587140.652176:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309954560 00000100:00100000:2.0:1788587140.652186:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309954560 00000100:00100000:2.0:1788587140.652246:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788587140.652256:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309954560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587140.652292:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587140.652352:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309954560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587140.652359:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788587140.652405:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309954560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587140.652689:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587140.652700:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309954688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587140.652755:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.652837:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309954688 00000100:00100000:3.0:1788587140.652842:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309954688 00000100:00100000:3.0:1788587140.652869:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587140.652876:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309954688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587140.652886:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587140.652905:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309954816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587140.652917:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309954688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.652922:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788587140.652935:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.652952:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309954688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587140.652970:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309954816 00000100:00100000:3.0:1788587140.652973:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309954816 00000100:00100000:3.0:1788587140.652995:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788587140.653002:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309954816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587140.653028:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587140.653078:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309954816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.653084:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788587140.653273:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309954816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587141.163126:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587141.163149:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309954944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587141.163231:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587141.163425:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309954944 00000100:00100000:1.0:1788587141.163446:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309954944 00000100:00100000:1.0:1788587141.163506:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788587141.163515:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309954944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587141.163553:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587141.163612:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309954944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587141.163618:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587141.163752:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309954944:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788587141.547066:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587142.251601:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788587142.254084:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788587142.572684:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587143.594900:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587144.240307:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309955456:0@lo:400:kworker.0 00000100:00100000:2.0:1788587144.240379:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587144.240449:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309955968:0@lo:400:kworker.0 00000100:00100000:2.0:1788587144.240507:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587144.240528:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309956480:0@lo:400:kworker.0 00000100:00100000:2.0:1788587144.240550:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587144.240574:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788587144.240580:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309955328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587144.240603:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587144.240619:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309955840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587144.240638:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587144.240652:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309956352:0@lo:400:kworker.0 00000100:00100000:2.0:1788587144.240669:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587144.240698:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309955968 00000100:00100000:2.0:1788587144.240705:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309955968 00000100:00100000:2.0:1788587144.240749:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309956480 00000100:00100000:2.0:1788587144.240753:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309956480 00000100:00100000:2.0:1788587144.240772:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788587144.240781:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309955968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587144.240849:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309955968:12345-0@lo:400:kworker.0 Request processed in 70us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587144.240857:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788587144.240873:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788587144.240880:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309956480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587144.240907:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309956480:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587144.240913:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788587144.240954:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309955968:0@lo:400:kworker.0 00010000:00080000:2.0:1788587144.240967:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34195500 x1875469309956480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587144.240985:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309956480:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241086:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309955456 00000100:00100000:3.0:1788587144.241091:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309955456 00000100:00100000:3.0:1788587144.241123:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309955840 00000100:00100000:3.0:1788587144.241126:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309955840 00000100:00100000:3.0:1788587144.241138:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309956352 00000100:00100000:3.0:1788587144.241141:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309956352 00000100:00100000:3.0:1788587144.241154:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788587144.241168:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309955456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241210:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309955456:12345-0@lo:400:kworker.0 Request processed in 44us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.241215:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788587144.241227:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788587144.241233:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309955840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241259:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309955840:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.241265:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788587144.241275:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788587144.241281:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309956352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241304:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309956352:12345-0@lo:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.241309:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:3.0:1788587144.241329:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587144.241333:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587144.241335:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587144.241350:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309955072:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241380:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.241416:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309955584:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241439:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.241456:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309956096:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241476:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.241492:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309956608:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241511:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.241545:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788587144.241551:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309955200:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241573:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.241588:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309955712:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241607:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.241621:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309956224:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241640:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.241662:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309955200 00000100:00100000:3.0:1788587144.241666:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309955200 00000100:00100000:3.0:1788587144.241685:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309955712 00000100:00100000:3.0:1788587144.241688:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309955712 00000100:00100000:3.0:1788587144.241705:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309956224 00000100:00100000:3.0:1788587144.241707:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309956224 00000100:00100000:3.0:1788587144.241720:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788587144.241725:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309955200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241759:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309955200:12345-0@lo:400:kworker.0 Request processed in 34us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.241765:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788587144.241777:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788587144.241782:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309955712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241838:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309955712:12345-0@lo:400:kworker.0 Request processed in 56us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.241844:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788587144.241857:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788587144.241862:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309956224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.241888:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309956224:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.241903:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788587144.241921:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309956096 00000100:00100000:3.0:1788587144.241925:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309956096 00000100:00100000:3.0:1788587144.241946:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309956608 00000100:00100000:3.0:1788587144.241949:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309956608 00000100:00100000:3.0:1788587144.241966:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788587144.241971:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309956096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242001:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309956096:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.242007:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788587144.242018:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788587144.242024:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309956608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242052:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309956608:12345-0@lo:400:kworker.0 Request processed in 29us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.242058:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788587144.242077:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587144.242080:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587144.242082:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587144.242090:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309955328 00000100:00100000:3.0:1788587144.242093:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309955328 00000100:00100000:3.0:1788587144.242108:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309955584 00000100:00100000:3.0:1788587144.242111:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309955584 00000100:00100000:3.0:1788587144.242122:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788587144.242128:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309955328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242161:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309955328:12345-0@lo:400:kworker.0 Request processed in 33us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.242167:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788587144.242185:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788587144.242191:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309955584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242221:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309955584:12345-0@lo:400:kworker.0 Request processed in 30us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.242226:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788587144.242261:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309955200:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242272:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309955712:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242280:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309956224:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242289:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309955584:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242296:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309956096:0@lo:400:kworker.0 00010000:00080000:3.0:1788587144.242307:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34194700 x1875469309956608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.242317:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309956608:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242374:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309955328:0@lo:400:kworker.0 00010000:00080000:3.0:1788587144.242386:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34196300 x1875469309955840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.242405:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309955840:0@lo:400:kworker.0 00010000:00080000:3.0:1788587144.242417:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34194a80 x1875469309956352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.242424:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309956352:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.242434:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309955456:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.246648:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309955072 00000100:00100000:1.0:1788587144.246662:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309955072 00000100:00100000:1.0:1788587144.246729:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788587144.246739:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309955072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.246867:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309955072:12345-0@lo:400:kworker.0 Request processed in 130us (5485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.246874:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788587144.251222:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309955072:0@lo:400:kworker.0 00010000:00010000:2.0:1788587144.619020:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587144.747711:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587144.747734:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309956736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587144.747814:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.748186:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309956736 00000100:00100000:3.0:1788587144.748195:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309956736 00000100:00100000:3.0:1788587144.748240:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788587144.748250:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309956736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587144.748283:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587144.748334:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309956736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.748341:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1788587144.748386:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3cc5f800 x1875469309956736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.748414:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309956736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587144.748610:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587144.748621:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309956864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587144.748653:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587144.748982:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309956864 00000100:00100000:0.0:1788587144.748987:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309956864 00000100:00100000:0.0:1788587144.749014:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788587144.749034:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309956864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587144.749048:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587144.749082:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309956864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587144.749088:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1788587144.749190:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0ed80 x1875469309956864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587144.749203:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309956864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587145.363293:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587145.363343:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587145.363373:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587145.363517:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292041088 00000100:00100000:2.0:1788587145.363527:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292041088 00000100:00100000:1.0:1788587145.363573:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292041344 00000100:00100000:2.0:1788587145.363584:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 371 00000100:00100000:2.0:1788587145.363594:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292041088:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587145.363644:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292041344 00000100:00100000:2.0:1788587145.363677:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292041088:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 83us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587145.363685:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 371 00000100:00100000:1.0:1788587145.363695:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292041216 00000100:00100000:1.0:1788587145.363700:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292041216 00000100:00100000:1.0:1788587145.363728:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 232 00000100:00100000:1.0:1788587145.363737:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292041344:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587145.363790:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292041344:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 55us (446us total) trans 0 rc 0/0 00000100:00080000:2.0:1788587145.363856:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587145.363860:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587145.363872:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 233 00000100:00100000:2.0:1788587145.363892:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292041216:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587145.363927:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292041216:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 47us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587145.363933:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 233 00000100:00100000:1.0:1788587145.364715:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 232 00000100:00100000:0.0:1788587145.376237:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587145.376478:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292041472 00000100:00100000:3.0:1788587145.376488:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292041472 00000100:00080000:2.0:1788587145.376621:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587145.376870:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788587145.376891:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2408:x1875469292041472:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:3.0:1788587145.376921:0:8101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343a53 00000100:00080000:3.0:1788587145.376930:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbf0493d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587145.376975:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788587145.377297:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+2:2408:x1875469292041472:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 417us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587145.377305:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00010000:00010000:1.0:1788587145.377372:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587145.377961:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587145.378017:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292041600 00000100:00100000:1.0:1788587145.378025:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292041600 00000100:00080000:2.0:1788587145.378049:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587145.378096:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 234 00000100:00100000:1.0:1788587145.378106:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292041600:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587145.378154:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292041600:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 50us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587145.378161:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 234 00000100:00100000:2.0:1788587145.383774:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587145.384473:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292041728 00000100:00100000:3.0:1788587145.384484:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292041728 00000100:00080000:2.0:1788587145.384598:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587145.386021:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 235 00000100:00100000:3.0:1788587145.386041:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292041728:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587145.386141:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292041728:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 108us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587145.386159:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 235 00010000:00010000:2.0:1788587145.645550:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587145.774862:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587145.774892:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf12e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309956992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587145.774963:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587145.775098:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309956992 00000100:00100000:3.0:1788587145.775107:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309956992 00000100:00100000:3.0:1788587145.775233:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788587145.775244:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309956992:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587145.775250:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587145.775262:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309957120:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587145.775281:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587145.775295:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587145.775368:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309957120 00000100:00100000:0.0:1788587145.775373:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309957120 00000100:00100000:1.0:1788587145.775381:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309957248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587145.775406:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788587145.775415:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309957120:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587145.775427:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788587145.775427:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587145.775486:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309957120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587145.775494:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788587145.775513:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309957120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587145.775548:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309957248 00000100:00100000:1.0:1788587145.775553:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309957248 00000100:00100000:1.0:1788587145.775589:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788587145.775597:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309957248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587145.775623:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587145.775675:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309957248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587145.775685:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309956992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 441us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587145.775685:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788587145.775694:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788587145.775736:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf12e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309956992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587145.775847:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309957248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587146.283628:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587146.283652:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309957376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587146.283736:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587146.283957:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309957376 00000100:00100000:0.0:1788587146.283965:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309957376 00000100:00100000:0.0:1788587146.284015:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788587146.284023:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309957376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587146.284068:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587146.284496:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309957376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587146.284507:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788587146.284597:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309957376:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587146.667047:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587147.690948:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587148.715050:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587149.356704:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309957760:0@lo:400:kworker.0 00000100:00100000:3.0:1788587149.356709:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309957888:0@lo:400:kworker.0 00000100:00100000:2.0:1788587149.356779:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309957504:0@lo:400:kworker.0 00000100:00100000:0.0:1788587149.356813:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309957632:0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.356892:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587149.356943:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309958272:0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.356968:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587149.356986:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309958784:0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.357006:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587149.357044:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309957760 00000100:00100000:1.0:1788587149.357051:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309957760 00000100:00100000:1.0:1788587149.357107:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788587149.357116:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309957760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.357168:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309957760:12345-0@lo:400:kworker.0 Request processed in 52us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.357175:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788587149.357198:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309958272 00000100:00100000:1.0:1788587149.357201:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309958272 00000100:00100000:1.0:1788587149.357230:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309958784 00000100:00100000:1.0:1788587149.357245:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309958784 00000100:00100000:1.0:1788587149.357269:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788587149.357276:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309958272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.357318:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309958272:12345-0@lo:400:kworker.0 Request processed in 42us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.357325:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788587149.357337:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788587149.357343:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309958784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.357382:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309958784:12345-0@lo:400:kworker.0 Request processed in 40us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.357405:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:1.0:1788587149.357433:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587149.357461:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3baced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309957760:0@lo:400:kworker.0 00010000:00080000:1.0:1788587149.357475:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdf800 x1875469309958272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587149.357485:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309958272:0@lo:400:kworker.0 00010000:00080000:1.0:1788587149.357494:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdd880 x1875469309958784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587149.357501:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309958784:0@lo:400:kworker.0 00000100:00100000:3.0:1788587149.359740:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587149.360028:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587149.360069:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309958400:0@lo:400:kworker.0 00000100:00100000:2.0:1788587149.360069:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309958016:0@lo:400:kworker.0 00000100:00100000:2.0:1788587149.360117:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587149.360122:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587149.360143:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309958528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587149.360151:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309958912:0@lo:400:kworker.0 00000100:00100000:3.0:1788587149.360196:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309957504 00000100:00100000:3.0:1788587149.360203:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309957504 00000100:00100000:2.0:1788587149.360228:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587149.360245:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788587149.360253:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309957504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587149.360291:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309957504:12345-0@lo:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587149.360297:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788587149.360400:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309959040:0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.360412:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309958016 00000100:00100000:1.0:1788587149.360417:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309958016 00000100:00100000:2.0:1788587149.360439:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587149.360451:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788587149.360458:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309958016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.360497:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309958016:12345-0@lo:400:kworker.0 Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.361141:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788587149.361170:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309957888 00000100:00100000:1.0:1788587149.361174:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309957888 00000100:00100000:1.0:1788587149.361205:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788587149.361212:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309957888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.361256:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309957888:12345-0@lo:400:kworker.0 Request processed in 44us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.361261:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788587149.361399:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587149.361426:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309958144:0@lo:400:kworker.0 00000100:00100000:0.0:1788587149.361452:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587149.361479:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309958656:0@lo:400:kworker.0 00000100:00100000:2.0:1788587149.361495:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309957504:0@lo:400:kworker.0 00000100:00100000:0.0:1788587149.361503:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587149.361513:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309958016:0@lo:400:kworker.0 00000100:00100000:2.0:1788587149.361657:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587149.364098:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309958400 00000100:00100000:3.0:1788587149.364113:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309958400 00000100:00100000:3.0:1788587149.364174:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309958528 00000100:00100000:3.0:1788587149.364177:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309958528 00000100:00100000:3.0:1788587149.364191:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309959040 00000100:00100000:3.0:1788587149.364194:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309959040 00000100:00100000:3.0:1788587149.364208:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788587149.364216:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309958400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587149.364289:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309958400:12345-0@lo:400:kworker.0 Request processed in 73us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587149.364295:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788587149.364311:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788587149.364317:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309958528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587149.364348:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309958528:12345-0@lo:400:kworker.0 Request processed in 31us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587149.364354:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788587149.364374:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788587149.364380:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309959040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587149.364402:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309959040:12345-0@lo:400:kworker.0 Request processed in 24us (3965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587149.364408:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788587149.364426:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587149.364429:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587149.364461:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309958528:0@lo:400:kworker.0 00010000:00080000:3.0:1788587149.364475:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdca80 x1875469309959040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587149.364485:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309959040:0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.364669:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309957632 00000100:00100000:1.0:1788587149.364680:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309957632 00000100:00100000:1.0:1788587149.364706:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309958144 00000100:00100000:1.0:1788587149.364708:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309958144 00000100:00100000:1.0:1788587149.364725:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788587149.364730:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309957632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.364774:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309957632:12345-0@lo:400:kworker.0 Request processed in 44us (3375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.364780:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788587149.364805:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309958656 00000100:00100000:1.0:1788587149.364808:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309958656 00000100:00100000:1.0:1788587149.364826:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788587149.364831:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309958144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.364860:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309958144:12345-0@lo:400:kworker.0 Request processed in 28us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.364866:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788587149.364877:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788587149.364882:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309958656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.364908:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309958656:12345-0@lo:400:kworker.0 Request processed in 26us (3406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.364916:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788587149.364976:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309957888:0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.364980:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309957632:0@lo:400:kworker.0 00000100:00100000:2.0:1788587149.365000:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309958400:0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.365002:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309958144:0@lo:400:kworker.0 00000100:00080000:2.0:1788587149.365044:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587149.365059:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309958912 00000100:00100000:2.0:1788587149.365063:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309958912 00000100:00100000:2.0:1788587149.365093:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788587149.365100:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309958912:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788587149.365421:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587149.365692:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309958912:12345-0@lo:400:kworker.0 Request processed in 591us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587149.365700:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1788587149.366117:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe04fdfb80 x1875469309958912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587149.366130:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309958912:0@lo:400:kworker.0 00000100:00100000:1.0:1788587149.366221:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309958656:0@lo:400:kworker.0 00010000:00010000:2.0:1788587149.739016:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587149.867626:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309959168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587149.867724:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587149.869064:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309959168 00000100:00100000:1.0:1788587149.869076:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309959168 00000100:00100000:1.0:1788587149.869210:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788587149.869229:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309959168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587149.869266:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587149.869354:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309959168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.869384:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788587149.869539:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309959296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587149.869581:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788587149.869867:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3cc5f100 x1875469309959168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587149.869887:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309959168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587149.871019:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309959296 00000100:00100000:1.0:1788587149.871029:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309959296 00000100:00100000:3.0:1788587149.873320:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788587149.873334:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309959296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587149.873370:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587149.873451:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309959296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587149.873458:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1788587149.873532:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f0ed80 x1875469309959296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587149.873557:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309959296:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788587149.949577:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:0.0:1788587149.949587:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbf04938000/12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:3.0:1788587149.949712:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf04938000/12266002-a8db-4050-aa6c-b9db12e6128d for lustre-OST0000 00000020:00000080:3.0:1788587149.949763:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf0493d800 for lustre-OST0000 00000100:00100000:1.0:1788587150.485485:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587150.485526:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587150.485547:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587150.485564:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587150.485586:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587150.485613:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292042112 00000100:00100000:1.0:1788587150.485622:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292042112 00000100:00100000:1.0:1788587150.485672:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292042368 00000100:00100000:1.0:1788587150.485676:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292042368 00000100:00100000:1.0:1788587150.485690:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292041984 00000100:00100000:1.0:1788587150.485693:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292041984 00000100:00100000:1.0:1788587150.485703:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292042240 00000100:00100000:1.0:1788587150.485706:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292042240 00000100:00100000:1.0:1788587150.485721:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 242 00000100:00100000:1.0:1788587150.485730:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292042112:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587150.485818:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292042112:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 90us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.485837:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 242 00000100:00100000:1.0:1788587150.485855:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 243 00000100:00100000:1.0:1788587150.485860:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292042368:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587150.485887:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292042368:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.485893:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 243 00000100:00100000:1.0:1788587150.485904:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 244 00000100:00100000:1.0:1788587150.485909:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292041984:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587150.485932:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292041984:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 22us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.485937:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 244 00000100:00100000:1.0:1788587150.485948:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 245 00000100:00100000:1.0:1788587150.485953:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292042240:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587150.485973:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292042240:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 20us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.485979:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 245 00000100:00080000:1.0:1788587150.486004:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587150.486008:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587150.486148:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292041856 00000100:00100000:1.0:1788587150.486153:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292041856 00000100:00100000:1.0:1788587150.486181:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 373 00000100:00100000:1.0:1788587150.486187:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292041856:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587150.486215:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292041856:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 29us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.486227:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 373 00010000:00010000:2.0:1788587150.764452:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587150.898423:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309959424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587150.898496:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587150.898694:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309959424 00000100:00100000:2.0:1788587150.898703:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309959424 00000100:00100000:2.0:1788587150.898754:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587150.898763:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309959424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587150.898814:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587150.898885:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309959424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587150.898892:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788587150.899001:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309959424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587150.901052:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587150.901071:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309959552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587150.901134:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587150.901179:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309959552 00000100:00100000:0.0:1788587150.901186:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309959552 00000100:00100000:0.0:1788587150.901225:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788587150.901233:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309959552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587150.901254:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587150.901296:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309959552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587150.901302:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788587150.901347:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309959552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587150.903191:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309959680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587150.903252:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587150.903310:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309959680 00000100:00100000:2.0:1788587150.903316:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309959680 00000100:00100000:2.0:1788587150.903365:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788587150.903375:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309959680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587150.903437:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587150.903483:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309959680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587150.903499:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788587150.903683:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309959680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587151.403114:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309959808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587151.403183:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587151.403273:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309959808 00000100:00100000:3.0:1788587151.403281:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309959808 00000100:00100000:3.0:1788587151.403330:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788587151.403340:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309959808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587151.403407:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587151.405909:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309959808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2561us (2717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587151.405923:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788587151.406337:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309959808:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587151.786931:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587152.493605:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788587152.495098:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587152.815844:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587153.835027:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587154.475481:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309960192:0@lo:400:kworker.0 00000100:00100000:1.0:1788587154.475564:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.475734:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309960704:0@lo:400:kworker.0 00000100:00100000:1.0:1788587154.475760:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.475779:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309961216:0@lo:400:kworker.0 00000100:00100000:1.0:1788587154.475879:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.475905:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788587154.475910:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309960320:0@lo:400:kworker.0 00000100:00100000:1.0:1788587154.475934:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.475958:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309960832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587154.475980:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.475998:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309961344:0@lo:400:kworker.0 00000100:00100000:1.0:1788587154.476018:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.476048:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309960704 00000100:00100000:1.0:1788587154.476055:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309960704 00000100:00100000:1.0:1788587154.476102:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309961216 00000100:00100000:1.0:1788587154.476105:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309961216 00000100:00100000:1.0:1788587154.476118:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309960320 00000100:00100000:1.0:1788587154.476120:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309960320 00000100:00100000:1.0:1788587154.476133:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788587154.476141:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309960704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.476345:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309959936:0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.476390:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587154.476415:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309960448:0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.476438:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587154.476456:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309960960:0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.476476:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587154.476493:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309961472:0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.476514:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587154.476532:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788587154.476548:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309960064:0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.476568:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587154.476578:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309960576:0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.476595:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587154.476789:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309961088:0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.476911:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587154.476939:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309960192 00000100:00100000:2.0:1788587154.476955:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309960192 00000100:00100000:2.0:1788587154.476979:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309960448 00000100:00100000:2.0:1788587154.476982:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309960448 00000100:00100000:2.0:1788587154.476994:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788587154.477000:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309960192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.477052:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309960192:12345-0@lo:400:kworker.0 Request processed in 51us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587154.477059:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788587154.477074:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788587154.477080:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309960448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.477112:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309960448:12345-0@lo:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587154.477119:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788587154.477135:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309960832 00000100:00100000:2.0:1788587154.477139:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309960832 00000100:00100000:2.0:1788587154.477169:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309961344 00000100:00100000:2.0:1788587154.477172:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309961344 00000100:00100000:2.0:1788587154.477182:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309960960 00000100:00100000:2.0:1788587154.477184:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309960960 00000100:00100000:2.0:1788587154.477195:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309961472 00000100:00100000:0.0:1788587154.477346:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788587154.477372:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309960832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587154.477409:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309960832:12345-0@lo:400:kworker.0 Request processed in 39us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587154.477415:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788587154.477428:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788587154.477433:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309961344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587154.477462:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309961344:12345-0@lo:400:kworker.0 Request processed in 28us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587154.477468:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788587154.477478:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788587154.477483:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309960960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587154.477508:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309960960:12345-0@lo:400:kworker.0 Request processed in 26us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587154.477513:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788587154.477567:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309960064 00000100:00100000:0.0:1788587154.477571:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309960064 00000100:00100000:0.0:1788587154.477588:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309960576 00000100:00100000:0.0:1788587154.477591:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309960576 00000100:00100000:0.0:1788587154.477781:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309961088 00000100:00100000:0.0:1788587154.477785:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309961088 00000100:00100000:3.0:1788587154.477991:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309960448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.478004:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309960960:0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.478047:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309959936 00000100:00100000:3.0:1788587154.478051:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309959936 00000100:00100000:3.0:1788587154.478080:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788587154.478087:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309959936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.478128:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309959936:12345-0@lo:400:kworker.0 Request processed in 41us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587154.478133:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788587154.478163:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788587154.478171:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309961216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587154.478492:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788587154.478500:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788587154.478516:0:6472:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788587154.478526:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788587154.478533:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309960320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.478676:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309961216:12345-0@lo:400:kworker.0 Request processed in 505us (2859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587154.478684:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788587154.478698:0:8126:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788587154.478705:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788587154.478712:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309960064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587154.478770:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309960704:12345-0@lo:400:kworker.0 Request processed in 2628us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587154.478777:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788587154.478931:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309960064:12345-0@lo:400:kworker.0 Request processed in 219us (2361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587154.478937:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788587154.478957:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788587154.478964:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309960576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.478995:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309960576:12345-0@lo:400:kworker.0 Request processed in 32us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587154.479001:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788587154.479012:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788587154.479017:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309961088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.479044:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309961088:12345-0@lo:400:kworker.0 Request processed in 27us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587154.479050:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1788587154.479065:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587154.479069:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587154.479072:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587154.479074:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587154.479095:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309960064:0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.479106:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309960576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.479115:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309961088:0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.479124:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309959936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.479179:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309960832:0@lo:400:kworker.0 00010000:00080000:3.0:1788587154.479193:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a7800 x1875469309961344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587154.479745:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309960320:12345-0@lo:400:kworker.0 Request processed in 1212us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587154.479752:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788587154.479977:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309961472 00000100:00100000:2.0:1788587154.480025:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788587154.480033:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309961472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587154.480078:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309961472:12345-0@lo:400:kworker.0 Request processed in 47us (3563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587154.480085:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1788587154.480117:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a7b80 x1875469309961472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587154.480142:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309961472:0@lo:400:kworker.0 00000100:00080000:0.0:1788587154.480680:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587154.481343:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309961344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.481437:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309960192:0@lo:400:kworker.0 00010000:00080000:3.0:1788587154.481465:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fd52680 x1875469309960704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587154.481475:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309960704:0@lo:400:kworker.0 00010000:00080000:3.0:1788587154.481487:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe064a5500 x1875469309961216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587154.481495:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309961216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587154.481522:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309960320:0@lo:400:kworker.0 00010000:00010000:0.0:1788587154.863731:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587154.991247:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309961600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587154.991320:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587154.991407:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309961600 00000100:00100000:2.0:1788587154.991416:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309961600 00000100:00100000:2.0:1788587154.991472:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587154.991481:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309961600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587154.991512:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587154.992086:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309961600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 603us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587154.992095:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1788587154.992139:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34195180 x1875469309961600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587154.992158:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309961600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587154.992485:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309961728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587154.992521:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.992580:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309961728 00000100:00100000:1.0:1788587154.992585:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309961728 00000100:00100000:1.0:1788587154.992616:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788587154.992625:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309961728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587154.992637:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587154.992674:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309961728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587154.992680:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1788587154.992707:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bacdc00 x1875469309961728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587154.992721:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309961728:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788587155.278616:0:13598:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:45:53 (1788587153) 00000100:00100000:1.0:1788587155.603974:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587155.604155:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587155.604185:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587155.604210:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587155.604400:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292042752 00000100:00100000:0.0:1788587155.604410:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292042752 00000100:00100000:0.0:1788587155.604467:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292043008 00000100:00100000:0.0:1788587155.604471:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292043008 00000100:00100000:0.0:1788587155.604492:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292042624 00000100:00100000:0.0:1788587155.604496:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292042624 00000100:00100000:0.0:1788587155.604513:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 252 00000100:00100000:0.0:1788587155.604522:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292042752:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587155.604615:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292042752:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 93us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587155.604623:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 252 00000100:00100000:0.0:1788587155.604642:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 253 00000100:00100000:0.0:1788587155.604648:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292043008:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587155.604674:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292043008:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587155.604680:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 253 00000100:00100000:3.0:1788587155.604732:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292042496 00000100:00100000:3.0:1788587155.604738:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292042496 00000100:00100000:0.0:1788587155.604773:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 254 00000100:00100000:3.0:1788587155.604778:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 375 00000100:00100000:0.0:1788587155.604787:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3baced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292042624:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587155.604817:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292042496:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587155.604908:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587155.604931:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292042496:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 142us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587155.604938:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 375 00000100:00100000:2.0:1788587155.605000:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292042880 00000100:00100000:2.0:1788587155.605006:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292042880 00000100:00100000:2.0:1788587155.605034:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 255 00000100:00100000:2.0:1788587155.605041:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292042880:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587155.607816:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3baced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292042624:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 3005us (3577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587155.607831:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 254 00000100:00080000:0.0:1788587155.607877:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587155.608758:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587155.610635:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292042880:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 5580us (5713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587155.610650:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 255 00010000:00010000:2.0:1788587155.882964:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587156.011037:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309961856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587156.011142:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587156.011185:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309961984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587156.011226:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309961856 00000100:00100000:2.0:1788587156.011232:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587156.011236:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309961856 00000100:00100000:0.0:1788587156.011287:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309961984 00000100:00100000:0.0:1788587156.011291:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309961984 00000100:00100000:0.0:1788587156.011326:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788587156.011335:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309961856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587156.011368:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587156.011412:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309961856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587156.011420:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788587156.011441:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788587156.011447:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587156.011452:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309961984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587156.011463:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587156.011465:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309962112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587156.011560:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309961856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587156.016712:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309961984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5254us (5472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587156.016728:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587156.017084:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309961984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587156.020560:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587156.021039:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309962112 00000100:00100000:2.0:1788587156.021049:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309962112 00000100:00100000:2.0:1788587156.021100:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788587156.021110:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309962112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587156.021154:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587156.021265:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309962112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587156.021273:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788587156.021728:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309962112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587156.523178:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587156.523202:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309962240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587156.523269:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587156.523685:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309962240 00000100:00100000:1.0:1788587156.523705:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309962240 00000100:00100000:3.0:1788587156.523857:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788587156.523869:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309962240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587156.523917:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587156.523977:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309962240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587156.523984:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788587156.524287:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309962240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788587156.908306:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587157.382134:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587157.382374:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292043136 00000100:00100000:0.0:1788587157.382384:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292043136 00000100:00100000:0.0:1788587157.382469:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:0.0:1788587157.382482:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:11219:x1875469292043136:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587157.382507:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587157.382559:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57f1 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.382630:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343b3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.382645:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.382659:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587157.382699:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587157.382703:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587157.382754:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.382780:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57f1 expref: 7 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.382833:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343b3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57f1 expref: 6 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.382843:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587157.382846:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587157.382849:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482c00, rc 0) 00000100:00100000:0.0:1788587157.382900:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:11219:x1875469292043136:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 421us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587157.382908:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00080000:3.0:1788587157.383407:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587157.397114:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587157.397280:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292043264 00000100:00100000:2.0:1788587157.397293:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292043264 00000100:00100000:2.0:1788587157.397365:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:2.0:1788587157.397376:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:11220:x1875469292043264:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587157.397395:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587157.397418:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57f8 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397484:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397499:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397511:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397535:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397556:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397574:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397835:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343b56 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397844:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343b56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397851:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343b56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587157.397875:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587157.397878:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587157.397900:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343b56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397909:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397915:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397922:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397928:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587157.397933:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397948:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397961:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587157.397964:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587157.397969:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397975:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397988:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397993:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.397998:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.398003:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587157.398006:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.398011:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.398018:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cbf03491100) 00010000:00010000:2.0:1788587157.398020:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587157.398022:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.398038:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.398083:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57f8 expref: 8 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.398097:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343b56 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57f8 expref: 7 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.398104:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf03491300) 00010000:00010000:2.0:1788587157.398106:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587157.398108:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045800, rc 0) 00000100:00100000:2.0:1788587157.398179:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:11220:x1875469292043264:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 803us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.398186:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:1.0:1788587157.407499:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587157.407589:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292043392 00000100:00100000:3.0:1788587157.407599:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292043392 00000100:00100000:3.0:1788587157.407655:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:3.0:1788587157.407665:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:12266002-a8db-4050-aa6c-b9db12e6128d+7:11220:x1875469292043392:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788587157.407999:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:12266002-a8db-4050-aa6c-b9db12e6128d+7:11220:x1875469292043392:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 Request processed in 333us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587157.408007:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788587157.418135:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587157.418368:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292043648 00000100:00100000:2.0:1788587157.418378:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292043648 00000100:00100000:2.0:1788587157.418439:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:2.0:1788587157.418451:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+7:11220:x1875469292043648:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587157.418472:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587157.418494:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343b5d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd57ff expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.418590:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.418606:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.418625:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.418699:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.418853:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.418864:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419410:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044000/0x419e1ae1f6343b72 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419421:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044000/0x419e1ae1f6343b72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419429:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044000/0x419e1ae1f6343b72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587157.419441:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788587157.419818:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419826:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419833:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419838:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587157.419851:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419858:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419870:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf03491300) 00010000:00010000:2.0:1788587157.419873:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587157.419876:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419883:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343b64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419896:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419902:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419908:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419913:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587157.419916:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419922:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419930:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cbf03491100) 00010000:00010000:2.0:1788587157.419933:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587157.419943:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.419948:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343b6b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.421095:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343b5d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ff expref: 10 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.421117:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044000/0x419e1ae1f6343b72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ff expref: 9 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.421125:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:2.0:1788587157.421128:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587157.421130:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044000, rc 0) 00000100:00100000:2.0:1788587157.421211:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+9:11220:x1875469292043648:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 2762us (3085us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788587157.421220:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:1.0:1788587157.432355:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587157.433113:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292043776 00000100:00100000:2.0:1788587157.433125:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292043776 00000100:00100000:2.0:1788587157.433182:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:2.0:1788587157.433202:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:11220:x1875469292043776:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788587157.433333:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:11220:x1875469292043776:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 134us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.433341:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:3.0:1788587157.436102:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587157.436462:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292043904 00000100:00100000:1.0:1788587157.436472:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292043904 00000100:00080000:3.0:1788587157.436637:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587157.436689:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:1.0:1788587157.436701:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+5:11220:x1875469292043904:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788587157.447934:0:13560:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10990us 00000100:00100000:1.0:1788587157.487760:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+5:11220:x1875469292043904:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 51043us (51648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587157.487774:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000040:00080000:3.0:1788587157.611882:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788587157.616537:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587157.933296:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587158.956529:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587159.498589:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587159.498723:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292044032 00000100:00100000:3.0:1788587159.498733:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292044032 00000100:00100000:3.0:1788587159.498826:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:3.0:1788587159.498838:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+9:11262:x1875469292044032:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587159.498858:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587159.498877:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343b80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5806 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.498937:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.498951:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.498978:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.498993:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499001:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499006:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499183:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499191:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499197:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499202:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587159.499206:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499214:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499225:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:3.0:1788587159.499228:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587159.499232:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499243:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499254:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499261:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499266:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499272:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587159.499275:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499281:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499289:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cbf02c76c00) 00010000:00010000:3.0:1788587159.499300:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587159.499304:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499309:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343b8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499340:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343b80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5806 expref: 10 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499360:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:3.0:1788587159.499362:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587159.499367:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343b80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5806 expref: 10 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.499375:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105200, rc 0) 00000100:00100000:3.0:1788587159.499438:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+9:11262:x1875469292044032:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 602us (858us total) trans 0 rc 301/301 00000100:00100000:3.0:1788587159.499445:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00080000:0.0:1788587159.499917:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587159.503641:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587159.503731:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292044288 00000100:00100000:0.0:1788587159.503742:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292044288 00000100:00100000:0.0:1788587159.503830:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:0.0:1788587159.503841:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:11262:x1875469292044288:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:0.0:1788587159.503904:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587159.503934:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343b3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57f1 expref: 9 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.503953:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587159.503965:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587159.504220:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.504234:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.504244:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.504256:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.504264:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.504270:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.506076:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.506093:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.506103:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587159.506118:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000707c86e6 reply state 000000008a79065d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.506129:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.506137:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587159.506140:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587159.506144:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788587159.506149:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788587159.506158:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.506165:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.507251:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.507264:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587159.507269:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.507289:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.507314:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8bef00) 00010000:00010000:0.0:1788587159.507317:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587159.507322:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.507329:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343b95 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587159.507353:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000707c86e6 reply state 000000008a79065d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.507364:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.507371:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cbf2c8be800) 00010000:00010000:0.0:1788587159.507373:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587159.507376:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788587159.507553:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+10:11262:x1875469292044288:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 3710us (3921us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788587159.507563:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:0.0:1788587159.595030:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe064a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309962368:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595120:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595165:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309962880:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595195:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595215:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309963392:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595252:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595271:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309963904:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595304:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595328:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788587159.595334:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309962752:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595359:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595377:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309963264:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595399:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595416:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309963776:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595436:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595465:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309962624:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595489:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595521:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309963136:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595546:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595564:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309963648:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595600:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595624:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788587159.595631:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309962496:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595654:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595670:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309963008:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595690:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595705:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309963520:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595732:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.595758:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309962368 00000100:00100000:0.0:1788587159.595771:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309962368 00000100:00100000:0.0:1788587159.595843:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788587159.595851:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309962368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.595909:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309962368:12345-0@lo:400:kworker.0 Request processed in 58us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.595918:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788587159.595953:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309962880 00000100:00100000:0.0:1788587159.595957:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309962880 00000100:00100000:0.0:1788587159.595976:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309962624 00000100:00100000:0.0:1788587159.595978:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309962624 00000100:00100000:0.0:1788587159.595996:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788587159.596003:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309962880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596038:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309962880:12345-0@lo:400:kworker.0 Request processed in 35us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596044:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788587159.596056:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788587159.596060:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309962624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596093:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309962624:12345-0@lo:400:kworker.0 Request processed in 32us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596099:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788587159.596119:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309963392 00000100:00100000:0.0:1788587159.596123:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309963392 00000100:00100000:0.0:1788587159.596151:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309963904 00000100:00100000:0.0:1788587159.596154:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309963904 00000100:00100000:0.0:1788587159.596165:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309963264 00000100:00100000:0.0:1788587159.596168:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309963264 00000100:00100000:0.0:1788587159.596179:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309963776 00000100:00100000:0.0:1788587159.596181:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309963776 00000100:00100000:0.0:1788587159.596194:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788587159.596208:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309963392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596241:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309963392:12345-0@lo:400:kworker.0 Request processed in 35us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596246:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788587159.596257:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788587159.596262:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309963904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596285:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309963904:12345-0@lo:400:kworker.0 Request processed in 24us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596302:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788587159.596314:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788587159.596319:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309963264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596344:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309963264:12345-0@lo:400:kworker.0 Request processed in 25us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596350:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788587159.596360:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788587159.596366:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309963776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596390:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309963776:12345-0@lo:400:kworker.0 Request processed in 25us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596397:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788587159.596418:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309962752 00000100:00100000:0.0:1788587159.596422:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309962752 00000100:00100000:0.0:1788587159.596440:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309963136 00000100:00100000:0.0:1788587159.596442:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309963136 00000100:00100000:0.0:1788587159.596452:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309963648 00000100:00100000:0.0:1788587159.596455:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309963648 00000100:00100000:0.0:1788587159.596466:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309962496 00000100:00100000:0.0:1788587159.596468:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309962496 00000100:00100000:0.0:1788587159.596487:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309963008 00000100:00100000:0.0:1788587159.596490:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309963008 00000100:00100000:0.0:1788587159.596501:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309963520 00000100:00100000:0.0:1788587159.596503:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309963520 00000100:00100000:0.0:1788587159.596515:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788587159.596520:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309962752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596551:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309962752:12345-0@lo:400:kworker.0 Request processed in 31us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596558:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788587159.596569:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788587159.596575:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309963136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596601:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309963136:12345-0@lo:400:kworker.0 Request processed in 26us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596607:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788587159.596617:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788587159.596623:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309963648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596647:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309963648:12345-0@lo:400:kworker.0 Request processed in 25us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596653:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788587159.596663:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788587159.596668:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309962496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596694:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309962496:12345-0@lo:400:kworker.0 Request processed in 26us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596700:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788587159.596711:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788587159.596717:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309963008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596755:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309963008:12345-0@lo:400:kworker.0 Request processed in 38us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596761:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788587159.596773:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788587159.596779:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309963520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596833:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309963520:12345-0@lo:400:kworker.0 Request processed in 54us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.596839:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:0.0:1788587159.596880:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587159.596885:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587159.596888:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587159.596890:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587159.596918:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309962496:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596930:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309963008:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596940:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309963520:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.596950:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309962624:0@lo:400:kworker.0 00010000:00080000:0.0:1788587159.596961:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf18716a00 x1875469309963136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587159.596972:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309963136:0@lo:400:kworker.0 00010000:00080000:0.0:1788587159.596981:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bda5880 x1875469309963648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587159.596989:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309963648:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.597026:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309962752:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.597044:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309963264:0@lo:400:kworker.0 00010000:00080000:0.0:1788587159.597054:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bda5f80 x1875469309963776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587159.597062:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309963776:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.597071:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe064a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309962368:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.597081:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309962880:0@lo:400:kworker.0 00000100:00100000:0.0:1788587159.597090:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309963392:0@lo:400:kworker.0 00010000:00080000:0.0:1788587159.597099:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bda4380 x1875469309963904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587159.597106:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309963904:0@lo:400:kworker.0 00000100:00100000:3.0:1788587159.644608:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587159.644642:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292044416 00000100:00100000:3.0:1788587159.644651:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292044416 00000100:00100000:3.0:1788587159.644698:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:3.0:1788587159.644707:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+10:11270:x1875469292044416:12345-192.168.203.14@tcp:101:lctl.0 00010000:00010000:3.0:1788587159.644731:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587159.644754:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd580d expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.644835:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.644848:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.644859:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587159.645537:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587159.645543:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587159.645586:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.645615:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd580d expref: 12 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.645631:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd580d expref: 11 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.645639:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:3.0:1788587159.645642:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587159.645646:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105200, rc 0) 00000100:00100000:3.0:1788587159.645701:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+11:11270:x1875469292044416:12345-192.168.203.14@tcp:101:lctl.0 Request processed in 995us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587159.645707:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:3.0:1788587159.731497:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587159.731562:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292044544 00000100:00100000:0.0:1788587159.731572:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292044544 00000100:00100000:0.0:1788587159.731635:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:0.0:1788587159.731645:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+11:11276:x1875469292044544:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587159.731665:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587159.731684:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343bb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5814 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731740:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731753:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731779:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731829:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731838:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731844:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731928:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343bcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731936:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.731942:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587159.731968:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788587159.731971:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587159.732009:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732020:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732026:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732042:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732047:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587159.732052:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732059:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732071:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:0.0:1788587159.732075:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587159.732079:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732085:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732103:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732109:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732115:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732120:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587159.732123:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732138:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732146:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cbf2c8be800) 00010000:00010000:0.0:1788587159.732148:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587159.732151:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732157:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343bc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732193:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5814 expref: 13 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732208:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343bcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5814 expref: 12 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.732214:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587159.732216:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587159.732219:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01483600, rc 0) 00000100:00100000:0.0:1788587159.732274:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+12:11276:x1875469292044544:12345-192.168.203.14@tcp:101:bash.0 Request processed in 630us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.732281:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788587159.735862:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587159.736005:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292044800 00000100:00100000:0.0:1788587159.736016:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292044800 00000100:00100000:0.0:1788587159.736081:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:0.0:1788587159.736092:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+12:11276:x1875469292044800:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587159.736128:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587159.736151:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343bd4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd581b expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.736303:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.736318:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.736329:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.736399:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.736407:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.736413:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587159.736988:0:6472:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788587159.737154:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737166:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737175:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737221:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737228:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737235:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737240:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587159.737245:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737252:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737263:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587159.737266:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587159.737271:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737277:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343bdb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587159.737305:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c79ffc29 reply state 00000000695c3971 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737317:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737323:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8bef00) 00010000:00010000:0.0:1788587159.737331:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587159.737335:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788587159.737366:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343bd4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737381:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 14 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.737388:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587159.737391:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587159.737393:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482200, rc 0) 00000100:00100000:0.0:1788587159.737471:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+15:11276:x1875469292044800:12345-192.168.203.14@tcp:101:bash.0 Request processed in 1381us (1621us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788587159.737479:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:1.0:1788587159.740853:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587159.740976:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292044928 00000100:00100000:0.0:1788587159.740986:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292044928 00000100:00100000:0.0:1788587159.741037:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:0.0:1788587159.741046:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1875469292044928:12345-192.168.203.14@tcp:8:bash.0 00010000:00080000:0.0:1788587159.741082:0:8101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:0.0:1788587159.741115:0:8101:0:(genops.c:1385:class_connect()) connect: client 12266002-a8db-4050-aa6c-b9db12e6128d, cookie 0x419e1ae1f6343bf7 00002000:00100000:0.0:1788587159.741127:0:8101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12266002-a8db-4050-aa6c-b9db12e6128d/ffff8cbe05da9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788587159.741149:0:8101:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788587159.741512:0:8101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788587159.741543:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbe05da8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587159.741649:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2408:x1875469292044928:12345-192.168.203.14@tcp:8:bash.0 Request processed in 602us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.741656:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:1.0:1788587159.744267:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587159.744372:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292045056 00000100:00100000:3.0:1788587159.744383:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292045056 00000100:00100000:3.0:1788587159.744489:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:3.0:1788587159.744500:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:0:x1875469292045056:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788587159.744528:0:8099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587159.744550:0:8099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5822 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587159.744599:0:8099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587159.744618:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788587159.744622:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587159.744632:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 7 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.744653:0:8099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 7 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.744667:0:8099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105000, rc 0) 00000100:00100000:3.0:1788587159.744732:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:0:x1875469292045056:12345-192.168.203.14@tcp:101:bash.0 Request processed in 234us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587159.744738:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:3.0:1788587159.747516:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587159.747606:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292045184 00000100:00100000:1.0:1788587159.747617:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292045184 00000100:00100000:1.0:1788587159.747683:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:1.0:1788587159.747694:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:11276:x1875469292045184:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788587159.747711:0:8100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587159.747743:0:8100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5829 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587159.747773:0:8100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 8 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587159.747783:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587159.747787:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587159.747828:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587159.747883:0:8100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 8 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587159.747898:0:8100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 8 pid: 8099 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587159.747912:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8100:1875469309964032:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587159.747985:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587159.750529:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587159.750645:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8100:1875469309964032:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587159.750679:0:8100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587159.750728:0:8100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc400, rc 0) 00000100:00100000:2.0:1788587159.750784:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:11276:x1875469292045184:12345-192.168.203.14@tcp:101:bash.0 Request processed in 3091us (3288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587159.750821:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00080000:0.0:1788587159.751667:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587159.752138:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292045312 00000100:00100000:3.0:1788587159.752148:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292045312 00010000:00010000:0.0:1788587159.752347:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 8 pid: 8099 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587159.752427:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:0.0:1788587159.752438:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292045312:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587159.752452:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587159.752475:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 8 pid: 8099 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.752489:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 8 pid: 8099 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.752525:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a3d856f/0x419e1ae1f6343bfe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5822 expref: 8 pid: 8099 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.752541:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587159.752545:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587159.752554:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.752564:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.752596:0:6458:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587159.752624:0:6458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6458:1875469309964160:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788587159.752702:0:6458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587159.757706:0:6458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6458:1875469309964160:192.168.203.14@tcp:105: 00010000:00010000:0.0:1788587159.757731:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587159.757785:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292045312:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 5348us (7279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587159.757834:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788587159.759545:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587159.759683:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292045568 00000100:00100000:0.0:1788587159.759692:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292045568 00000100:00100000:0.0:1788587159.759747:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:0.0:1788587159.759759:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+15:11276:x1875469292045568:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:0.0:1788587159.760131:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+16:11276:x1875469292045568:12345-192.168.203.14@tcp:35:bash.0 Request processed in 374us (593us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788587159.760139:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788587159.895943:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587159.896036:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292045824 00000100:00100000:3.0:1788587159.896046:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292045824 00000100:00100000:3.0:1788587159.896110:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:3.0:1788587159.896120:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+16:11286:x1875469292045824:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587159.896144:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587159.896164:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343c0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5830 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587159.896285:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587159.896417:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343c0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5830 expref: 18 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.896430:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:3.0:1788587159.896433:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587159.896439:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343c0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5830 expref: 18 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.896453:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105a00, rc 0) 00000100:00100000:3.0:1788587159.896529:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+17:11286:x1875469292045824:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 410us (594us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788587159.896535:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:3.0:1788587159.899625:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587159.899737:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292046080 00000100:00100000:0.0:1788587159.899748:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292046080 00000100:00100000:0.0:1788587159.899843:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788587159.899854:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+17:11286:x1875469292046080:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788587159.900088:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+18:11286:x1875469292046080:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 236us (474us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788587159.900096:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00010000:00010000:2.0:1788587159.978979:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587160.014645:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587160.014971:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292046208 00000100:00100000:3.0:1788587160.014981:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292046208 00000100:00100000:3.0:1788587160.015036:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:3.0:1788587160.015047:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+18:11292:x1875469292046208:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587160.015073:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587160.015097:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343c1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5837 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.015167:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343c21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.015182:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.015206:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587160.015240:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788587160.015244:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587160.015264:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.015303:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343c1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5837 expref: 20 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.015322:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343c21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5837 expref: 19 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.015330:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:3.0:1788587160.015333:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587160.015337:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105c00, rc 0) 00000100:00100000:3.0:1788587160.015403:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:11292:x1875469292046208:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 358us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587160.015412:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:1.0:1788587160.023591:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587160.023672:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292046464 00000100:00100000:3.0:1788587160.023682:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292046464 00000100:00100000:3.0:1788587160.023744:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788587160.023756:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+19:11292:x1875469292046464:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587160.023777:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587160.023824:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343c28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd583e expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.023940:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343c2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.023955:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343c2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.023967:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343c2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587160.023978:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788587160.024121:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343c28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd583e expref: 22 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.024142:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343c2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd583e expref: 21 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.024151:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:3.0:1788587160.024153:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587160.024157:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37104800, rc 0) 00000100:00100000:3.0:1788587160.024347:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+21:11292:x1875469292046464:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 591us (764us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788587160.024355:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:2.0:1788587160.028706:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587160.028786:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587160.031719:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292046592 00000100:00100000:1.0:1788587160.031735:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292046592 00000100:00100000:1.0:1788587160.031890:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587160.031902:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:2411:x1875469292046592:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587160.031918:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587160.031942:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343c2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd583e expref: 21 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.031962:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:1.0:1788587160.031967:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587160.032026:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+20:2411:x1875469292046592:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 125us (3328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587160.032050:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788587160.032142:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292046848 00000100:00100000:0.0:1788587160.032147:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292046848 00000100:00100000:0.0:1788587160.032197:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:0.0:1788587160.032204:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+20:11292:x1875469292046848:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587160.032223:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587160.032240:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5845 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.032337:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.032351:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.032362:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587160.032374:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788587160.032490:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5845 expref: 23 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.032517:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5845 expref: 22 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.032525:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587160.032528:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788587160.032530:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01483200, rc 0) 00000100:00100000:0.0:1788587160.032566:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+22:11292:x1875469292046848:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 362us (3779us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788587160.032572:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:3.0:1788587160.038639:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587160.038983:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292046976 00000100:00100000:2.0:1788587160.038993:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292046976 00000100:00100000:2.0:1788587160.039051:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:2.0:1788587160.039061:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292046976:12345-192.168.203.14@tcp:1:lfs.0 00010000:00010000:2.0:1788587160.039271:0:8099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.039302:0:8099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.039382:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587160.039386:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587160.039391:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.039427:0:8099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.039460:0:8099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587160.039476:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8099:1875469309964288:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587160.039874:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587160.044922:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587160.045026:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292047104 00000100:00100000:1.0:1788587160.045036:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292047104 00002000:00100000:1.0:1788587160.045081:0:8105:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8cbf3bd51180 x1875469292047104/t0(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:476/0 lens 504/0 e 0 to 0 dl 1788587171 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587160.045093:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf3bd51180 with x1875469292047104 ext(0->12) 00010000:00010000:1.0:1788587160.045102:0:8105:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 8 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.045119:0:8105:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 8 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587160.045137:0:8105:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbf3bd51180 00000100:00100000:1.0:1788587160.045164:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:1.0:1788587160.045183:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292047104:12345-192.168.203.14@tcp:4:lfs.0 00000100:00100000:2.0:1788587160.046427:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8099:1875469309964288:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587160.046453:0:8099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587160.111779:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309964416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587160.111863:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587160.111921:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309964416 00000100:00100000:0.0:1788587160.111927:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309964416 00000100:00100000:0.0:1788587160.111975:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788587160.111984:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309964416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587160.112021:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587160.112065:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309964416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.112072:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788587160.112119:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309964416:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788587160.116982:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000100:00100000:0.0:1788587160.117333:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309964544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587160.117399:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587160.117452:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309964544 00000100:00100000:0.0:1788587160.117459:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309964544 00000100:00100000:0.0:1788587160.117521:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788587160.117531:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309964544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587160.117553:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587160.117598:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309964544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.117604:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788587160.118240:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309964544:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1788587160.153365:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967318 is committed 00010000:00010000:3.0:1788587160.153972:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.153985:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154011:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154018:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587160.154023:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154031:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154047:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cbf2c8be800) 00010000:00010000:3.0:1788587160.154050:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587160.154055:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154062:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343b9c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154084:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154090:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154095:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154101:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587160.154103:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154119:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154128:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:3.0:1788587160.154130:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587160.154133:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154138:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ba3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154154:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154160:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154178:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154183:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587160.154185:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154190:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154198:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8bef00) 00010000:00010000:3.0:1788587160.154200:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587160.154203:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.154215:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343be2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587160.189462:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:2410:x1875469292047104:12345-192.168.203.14@tcp:4:lfs.0 Request processed in 144270us (144539us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788587160.189482:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00002000:00100000:0.0:1788587160.189515:0:8105:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8cbf3bd51180 x1875469292047104/t4294967300(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:476/0 lens 504/448 e 0 to 0 dl 1788587171 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788587160.189526:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf3bd51180 with x1875469292047104 ext(0->12) 00010000:00010000:0.0:1788587160.189539:0:8105:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 9 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.189555:0:8105:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 9 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587160.189563:0:8105:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbf3bd51180 00000001:00080000:3.0:1788587160.190336:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1788587160.202400:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587160.202514:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292047232 00000100:00100000:2.0:1788587160.202525:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292047232 00010000:00010000:2.0:1788587160.202570:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587160.202612:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:2.0:1788587160.202624:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292047232:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587160.202641:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788587160.202660:0:6458:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788587160.202663:0:6458:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788587159 00002000:00010000:2.0:1788587160.202665:0:6458:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788587159 00002000:00010000:2.0:1788587160.202667:0:6458:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788587159 00002000:00010000:2.0:1788587160.202669:0:6458:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788587160.202675:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.202702:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.202725:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6343c05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5829 expref: 7 pid: 8100 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.202743:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587160.202748:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587160.202754:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.202763:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.202842:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587160.202890:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292047232:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 268us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587160.202898:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00010000:00010000:0.0:1788587160.202964:0:8099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.202973:0:8099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.202998:0:8099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.203007:0:8099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.203014:0:8099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.203032:0:8099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587160.203037:0:8099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.203058:0:8099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.203070:0:8099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.203077:0:8099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf22833c/0x419e1ae1f6343c52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587160.203126:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292046976:12345-192.168.203.14@tcp:1:lfs.0 Request processed in 164067us (164507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.203134:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:2.0:1788587160.212552:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.212789:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292047488 00000100:00100000:0.0:1788587160.212814:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292047488 00000100:00100000:0.0:1788587160.212877:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788587160.212888:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+12:11292:x1875469292047488:12345-192.168.203.14@tcp:35:lfs.0 00000004:00010000:0.0:1788587160.212950:0:6476:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5845 expref: 12 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587160.213376:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788587160.213435:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788587160.214001:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788587160.214062:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.214079:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 16 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.214087:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.214124:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 16 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.214138:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 16 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587160.214152:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6476:1875469309964672:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587160.214239:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587160.219086:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587160.219117:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6476:1875469309964672:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788587160.219144:0:6476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587160.219250:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292047616 00000100:00100000:1.0:1788587160.219258:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292047616 00010000:00010000:1.0:1788587160.219303:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 17 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587160.219345:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:1.0:1788587160.219355:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+17:2410:x1875469292047616:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587160.219370:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587160.219378:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 17 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.219405:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 17 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.219428:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343be9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd581b expref: 17 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.219447:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:1.0:1788587160.219452:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.219462:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.219470:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.219501:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587160.219728:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+16:2410:x1875469292047616:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 372us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587160.219735:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00010000:00010000:3.0:1788587160.220909:0:6476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.220924:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587160.221052:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788587160.222297:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788587160.222421:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd52680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309964800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788587160.222487:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587160.223323:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587160.223338:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309964800 00000100:00100000:0.0:1788587160.223349:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309964800 00000100:00100000:0.0:1788587160.223414:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788587160.223425:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6476:x1875469309964800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587160.223531:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6476:x1875469309964800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.223539:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788587160.224772:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd52680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309964800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788587160.225499:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788587160.225577:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309964928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788587160.225636:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587160.225670:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587160.225834:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309964928 00000100:00100000:0.0:1788587160.225841:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309964928 00000100:00100000:0.0:1788587160.225879:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788587160.225897:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6476:x1875469309964928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587160.226152:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6476:x1875469309964928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 256us (514us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788587160.226160:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788587160.226360:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309964928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788587160.226409:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788587160.226459:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.226470:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.226478:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.226484:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587160.226489:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.226498:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.226512:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587160.226515:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788587160.226520:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.226526:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c59 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587160.226752:0:6476:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788587160.226980:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788587160.226991:0:6476:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357976196336ns, next at 358976194293ns, rc = 0 00000001:00080000:2.0:1788587160.226999:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788587160.227032:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587160.227035:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587160.227115:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c44 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5845 expref: 20 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587160.227233:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:11292:x1875469292047488:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 14346us (14690us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788587160.227241:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000020:00080000:2.0:1788587160.227245:0:6476:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788587160.233509:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587160.233595:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292047744 00000100:00100000:2.0:1788587160.233605:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292047744 00000100:00100000:2.0:1788587160.233663:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:2.0:1788587160.233672:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+19:11292:x1875469292047744:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587160.233693:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587160.233716:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343c60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd584c expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.233784:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343c60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd584c expref: 20 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.233829:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343c60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd584c expref: 20 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587160.233849:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:2.0:1788587160.233853:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587160.233856:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044e00, rc 0) 00000100:00100000:2.0:1788587160.233916:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+20:11292:x1875469292047744:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 244us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587160.233925:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:1.0:1788587160.243088:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587160.243235:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292048000 00000100:00100000:2.0:1788587160.243244:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292048000 00000100:00100000:2.0:1788587160.243321:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788587160.243331:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+20:11292:x1875469292048000:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788587160.243563:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:11292:x1875469292048000:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 233us (483us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788587160.243571:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:3.0:1788587160.376958:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.377066:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292048256 00000100:00100000:0.0:1788587160.377077:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292048256 00000100:00100000:0.0:1788587160.377147:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:0.0:1788587160.377157:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+21:11302:x1875469292048256:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587160.377181:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587160.377203:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5853 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587160.377305:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788587160.377434:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5853 expref: 23 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.377453:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:0.0:1788587160.377456:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587160.377462:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5853 expref: 23 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.377479:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482c00, rc 0) 00000100:00100000:0.0:1788587160.377552:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+22:11302:x1875469292048256:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 396us (606us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788587160.377558:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:1.0:1788587160.387889:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.387989:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292048384 00000100:00100000:0.0:1788587160.388012:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292048384 00000100:00100000:0.0:1788587160.388075:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:0.0:1788587160.388085:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+22:11302:x1875469292048384:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:0.0:1788587160.388164:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.388181:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.388194:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.388210:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.388218:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.388224:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.388477:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.388485:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.388492:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587160.391080:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391126:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391133:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391140:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391145:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587160.391149:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391157:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391175:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587160.391178:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587160.391183:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391189:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391207:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391213:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391218:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391229:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587160.391231:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391237:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391245:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587160.391247:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587160.391250:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391256:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391273:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391280:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391296:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391301:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587160.391304:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391310:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391333:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587160.391335:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587160.391338:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.391344:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587160.391438:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+22:11302:x1875469292048384:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 3350us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.391447:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:1.0:1788587160.394989:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587160.395085:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292048640 00000100:00100000:2.0:1788587160.395095:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292048640 00000100:00100000:2.0:1788587160.395149:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788587160.395160:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+22:11302:x1875469292048640:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788587160.395416:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+23:11302:x1875469292048640:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 256us (435us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788587160.395424:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:3.0:1788587160.460309:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.460426:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292048896 00000100:00100000:0.0:1788587160.460438:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292048896 00000100:00100000:0.0:1788587160.460510:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:0.0:1788587160.460522:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+23:11305:x1875469292048896:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587160.460547:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587160.460569:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd585a expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.460644:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.460659:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.460670:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.460685:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.460705:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.460712:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.460993:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461003:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461011:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587160.461021:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788587160.461112:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461120:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461127:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461133:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587160.461138:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461145:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461167:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587160.461170:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587160.461175:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461182:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343c91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461199:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461205:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461211:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461216:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587160.461219:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461226:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461232:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587160.461235:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587160.461237:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461243:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343c98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461302:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343c8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 26 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461317:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 25 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.461324:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587160.461326:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587160.461329:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482a00, rc 0) 00000100:00100000:0.0:1788587160.461381:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+25:11305:x1875469292048896:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 862us (1094us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788587160.461388:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:1.0:1788587160.471214:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587160.471314:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292049024 00000100:00100000:3.0:1788587160.471328:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292049024 00000100:00100000:3.0:1788587160.471391:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:3.0:1788587160.471402:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+25:11305:x1875469292049024:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:3.0:1788587160.471473:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471515:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471528:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471556:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471562:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471569:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471575:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587160.471579:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471587:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471599:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587160.471601:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587160.471605:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.471612:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343cad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587160.471691:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+25:11305:x1875469292049024:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 290us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587160.471705:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:1.0:1788587160.474680:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587160.474776:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292049280 00000100:00100000:2.0:1788587160.474785:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292049280 00000100:00100000:2.0:1788587160.474875:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788587160.474886:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+25:11305:x1875469292049280:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788587160.475146:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+26:11305:x1875469292049280:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 260us (473us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788587160.475155:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:0.0:1788587160.730072:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.730110:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.730146:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.730179:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.730214:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.730243:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292049536 00000100:00100000:0.0:1788587160.730251:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292049536 00000100:00100000:0.0:1788587160.730320:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292049792 00000100:00100000:0.0:1788587160.730323:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292049792 00000100:00100000:0.0:1788587160.730338:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292049920 00000100:00100000:0.0:1788587160.730340:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292049920 00000100:00100000:0.0:1788587160.730355:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 262 00000100:00100000:0.0:1788587160.730364:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292049536:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587160.730432:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292049536:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 68us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.730448:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 262 00000100:00100000:0.0:1788587160.730463:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 263 00000100:00100000:0.0:1788587160.730468:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292049792:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587160.730490:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292049792:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 22us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.730510:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 263 00000100:00100000:0.0:1788587160.730520:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 264 00000100:00100000:0.0:1788587160.730526:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292049920:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587160.730545:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292049920:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 20us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.730550:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 264 00000100:00080000:0.0:1788587160.730564:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587160.730567:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587160.731217:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292049408 00000100:00100000:2.0:1788587160.731225:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292049408 00000100:00100000:2.0:1788587160.731267:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 377 00000100:00100000:2.0:1788587160.731273:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292049408:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587160.731328:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292049408:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 55us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587160.731344:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 377 00000100:00100000:2.0:1788587160.731376:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292049664 00000100:00100000:2.0:1788587160.731380:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292049664 00000100:00100000:2.0:1788587160.731404:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:2.0:1788587160.731410:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292049664:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587160.731434:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292049664:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587160.731439:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:2.0:1788587160.845733:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.845822:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292050176 00000100:00100000:0.0:1788587160.845831:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292050176 00000100:00100000:0.0:1788587160.845940:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:0.0:1788587160.845961:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+26:11336:x1875469292050176:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:0.0:1788587160.845984:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587160.846004:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343cb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5861 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.846098:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.846113:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.846138:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587160.846149:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788587160.846301:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343cb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5861 expref: 29 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.846323:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5861 expref: 28 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.846332:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587160.846335:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587160.846338:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482e00, rc 0) 00000100:00100000:0.0:1788587160.847598:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+28:11336:x1875469292050176:12345-192.168.203.14@tcp:101:cat.0 Request processed in 1642us (1868us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788587160.847609:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:1.0:1788587160.855238:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587160.855292:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587160.855439:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292050304 00000100:00100000:3.0:1788587160.855449:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292050304 00000100:00100000:3.0:1788587160.855611:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788587160.855622:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+28:2409:x1875469292050304:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587160.855640:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587160.855669:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5861 expref: 28 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.855694:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587160.855699:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587160.855762:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+27:2409:x1875469292050304:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 141us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587160.855769:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:2.0:1788587160.856196:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292050560 00000100:00100000:2.0:1788587160.856203:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292050560 00000100:00100000:2.0:1788587160.856236:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788587160.856242:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+27:11336:x1875469292050560:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:2.0:1788587160.856529:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+28:11336:x1875469292050560:12345-192.168.203.14@tcp:35:cat.0 Request processed in 285us (1246us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788587160.856537:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:1.0:1788587160.950739:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587160.951013:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292050816 00000100:00100000:0.0:1788587160.951024:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292050816 00000100:00100000:0.0:1788587160.951127:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:0.0:1788587160.951138:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+28:11342:x1875469292050816:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:0.0:1788587160.951161:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587160.951164:0:8126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788587160.951189:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343c21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5837 expref: 28 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.951210:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587160.951222:0:8126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587160.951236:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343cc9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5868 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.952305:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.952325:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 28 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.952334:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.952366:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 28 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.952381:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 28 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587160.952395:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309965056:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587160.952499:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587160.958729:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587160.959067:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292050944 00000100:00100000:1.0:1788587160.959077:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292050944 00010000:00010000:1.0:1788587160.959118:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 29 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587160.959159:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:1.0:1788587160.959170:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+29:2409:x1875469292050944:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587160.959193:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587160.959200:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 29 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.959213:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 29 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.959242:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:1.0:1788587160.959247:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.959257:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.959264:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587160.959292:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587160.959348:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+29:2409:x1875469292050944:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 178us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587160.959355:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00010000:00010000:0.0:1788587160.960139:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343c9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd585a expref: 28 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587160.960163:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309965056:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587160.960250:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.960261:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.960293:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587160.960312:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788587160.960483:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343cc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 29 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.960500:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 28 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587160.960739:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587160.960742:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587160.960745:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482200, rc 0) 00000100:00100000:0.0:1788587160.960846:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+28:11342:x1875469292050816:12345-192.168.203.14@tcp:101:dd.0 Request processed in 9709us (10116us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788587160.960854:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:2.0:1788587160.965449:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587160.965539:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292051200 00000100:00100000:3.0:1788587160.965549:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292051200 00000100:00100000:3.0:1788587160.965609:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:3.0:1788587160.965619:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+28:11342:x1875469292051200:12345-192.168.203.14@tcp:36:dd.0 00010000:00010000:3.0:1788587160.965934:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.965953:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.965964:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587160.966039:0:6473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788587160.966064:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd44e71b reply state 0000000016650431 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.966077:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587160.966085:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587160.966087:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587160.966091:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587160.966169:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+31:11342:x1875469292051200:12345-192.168.203.14@tcp:36:dd.0 Request processed in 551us (728us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788587160.966187:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000020:00080000:3.0:1788587160.966192:0:6473:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587161.003674:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587161.131082:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309965184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587161.131086:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309965312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587161.131313:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587161.131327:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309965440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587161.132968:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587161.133127:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309965312 00000100:00100000:3.0:1788587161.133136:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309965312 00000100:00100000:3.0:1788587161.133209:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788587161.133220:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309965312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587161.133257:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587161.133322:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309965312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587161.133330:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788587161.133664:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587161.133706:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309965312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587161.134740:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587161.134892:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309965184 00000100:00100000:0.0:1788587161.134899:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309965184 00000100:00100000:0.0:1788587161.134963:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587161.134972:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309965184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587161.134993:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587161.135042:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309965184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.135062:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587161.135123:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309965184:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788587161.135453:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587161.137047:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587161.137355:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309965440 00000100:00100000:0.0:1788587161.137364:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309965440 00000100:00100000:0.0:1788587161.137479:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788587161.137490:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309965440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587161.137562:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587161.137627:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309965440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.137634:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788587161.137705:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309965440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587161.231575:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.231662:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292051328 00000100:00100000:0.0:1788587161.231673:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292051328 00000100:00100000:0.0:1788587161.231742:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:0.0:1788587161.231754:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+31:11356:x1875469292051328:12345-192.168.203.14@tcp:101:stat.0 00010000:00010000:0.0:1788587161.231774:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.231817:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343ce5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd586f expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.231879:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.231893:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.231904:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.231917:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.231936:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.231942:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.232149:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.232159:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 32 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.232168:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.232211:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 32 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.232225:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 32 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587161.232238:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309965568:192.168.203.14@tcp:104: 00000100:00080000:1.0:1788587161.232477:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587161.232697:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587161.236115:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.236238:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309965568:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587161.236267:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587161.236487:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292051584 00000100:00100000:2.0:1788587161.236495:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292051584 00000100:00100000:2.0:1788587161.236571:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:2.0:1788587161.236589:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+33:6381:x1875469292051584:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788587161.237116:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+34:6381:x1875469292051584:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 528us (1009us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788587161.237124:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:2.0:1788587161.244973:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587161.246867:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292051712 00000100:00100000:3.0:1788587161.246883:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292051712 00010000:00010000:3.0:1788587161.246935:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 34 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587161.247277:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:3.0:1788587161.247296:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+34:2410:x1875469292051712:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587161.247312:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587161.247319:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 34 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.247332:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 34 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.247354:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343cd0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5868 expref: 34 pid: 8126 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.247375:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587161.247380:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.247400:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.247408:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.247492:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587161.247566:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+33:2410:x1875469292051712:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 271us (3549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587161.247574:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00010000:00010000:0.0:1788587161.248088:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248106:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.248153:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788587161.248157:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587161.248196:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248317:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248331:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248338:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248344:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248349:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587161.248353:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248362:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248374:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587161.248377:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.248381:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248459:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343cec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248474:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248480:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248487:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248492:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587161.248495:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248501:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248579:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587161.248582:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.248586:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248591:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343cf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248628:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343ce5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd586f expref: 33 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248661:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd586f expref: 32 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.248668:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587161.248671:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587161.248673:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01483200, rc 0) 00000100:00100000:0.0:1788587161.248726:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+32:11356:x1875469292051328:12345-192.168.203.14@tcp:101:stat.0 Request processed in 16974us (17159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.248734:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:2.0:1788587161.356833:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.357036:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292051968 00000100:00100000:0.0:1788587161.357046:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292051968 00000100:00100000:0.0:1788587161.357108:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:0.0:1788587161.357118:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+32:11362:x1875469292051968:12345-192.168.203.14@tcp:36:truncate.0 00010000:00010000:0.0:1788587161.357192:0:8126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587161.357230:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343cfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd586f expref: 32 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.357255:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587161.357260:0:8126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587161.357737:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.357755:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.357767:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587161.357883:0:8126:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788587161.357912:0:8126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fb49b65 reply state 000000003413723a transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.357924:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.357931:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587161.357933:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587161.357937:0:8126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587161.358070:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+34:11362:x1875469292051968:12345-192.168.203.14@tcp:36:truncate.0 Request processed in 950us (1243us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788587161.358078:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00000020:00080000:0.0:1788587161.358083:0:8126:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788587161.559975:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.560288:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292052096 00000100:00100000:0.0:1788587161.560298:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292052096 00000100:00100000:0.0:1788587161.560404:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:0.0:1788587161.560413:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+34:11376:x1875469292052096:12345-192.168.203.14@tcp:101:stat.0 00010000:00010000:0.0:1788587161.560436:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.560455:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5876 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560514:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560528:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560540:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560566:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560573:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560579:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560852:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560862:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560869:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.560913:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788587161.560919:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587161.560941:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560954:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560962:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.560968:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561407:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561414:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587161.561418:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561426:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561439:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587161.561442:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.561446:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561453:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561471:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561477:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561483:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561488:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587161.561700:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561718:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561727:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587161.561729:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.561732:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561738:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561786:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 36 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561841:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 35 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.561849:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587161.561852:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587161.561855:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482200, rc 0) 00000100:00100000:0.0:1788587161.561926:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+35:11376:x1875469292052096:12345-192.168.203.14@tcp:101:stat.0 Request processed in 1513us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.561935:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:3.0:1788587161.644301:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587161.644348:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3a739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309965696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587161.644432:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587161.644582:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309965696 00000100:00100000:1.0:1788587161.644592:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309965696 00000100:00100000:1.0:1788587161.644646:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788587161.644656:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309965696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587161.644712:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587161.644784:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309965696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587161.644817:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587161.644967:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3a739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309965696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587161.669113:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.669274:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292052352 00000100:00100000:0.0:1788587161.669294:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292052352 00000100:00100000:0.0:1788587161.669358:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:0.0:1788587161.669367:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+35:11386:x1875469292052352:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587161.669404:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.669426:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd587d expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.669642:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788587161.669782:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d24 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd587d expref: 37 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.669825:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:0.0:1788587161.669829:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587161.669836:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd587d expref: 37 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.669854:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01483200, rc 0) 00000100:00100000:0.0:1788587161.670653:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+36:11386:x1875469292052352:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 554us (816us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788587161.670666:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:1.0:1788587161.675343:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587161.675487:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292052608 00000100:00100000:3.0:1788587161.675507:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292052608 00000100:00100000:3.0:1788587161.675564:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:3.0:1788587161.675575:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+36:11386:x1875469292052608:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587161.675862:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+37:11386:x1875469292052608:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 288us (528us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788587161.675869:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:1.0:1788587161.778729:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.778817:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292052864 00000100:00100000:0.0:1788587161.778827:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292052864 00000100:00100000:0.0:1788587161.778888:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:0.0:1788587161.778899:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+37:11392:x1875469292052864:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587161.778921:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.778942:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d32 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5884 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.779066:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.779105:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 38 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.779115:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.779148:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 38 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.779173:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 38 pid: 6474 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587161.779185:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309965824:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587161.779269:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587161.789377:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587161.790850:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292052992 00000100:00100000:2.0:1788587161.790865:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292052992 00010000:00010000:2.0:1788587161.790924:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 39 pid: 6474 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587161.790973:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:2.0:1788587161.790984:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+39:2409:x1875469292052992:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587161.790999:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587161.791007:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 39 pid: 6474 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.791022:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 39 pid: 6474 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.791043:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:2.0:1788587161.791048:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.791058:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.791066:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.791115:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587161.791198:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+39:2409:x1875469292052992:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 214us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587161.791206:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00010000:00010000:0.0:1788587161.791962:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5876 expref: 38 pid: 6474 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587161.791984:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309965824:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587161.792004:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.792013:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.792018:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.792036:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788587161.792200:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 39 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.792228:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 38 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.792238:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587161.792240:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587161.792243:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482a00, rc 0) 00000100:00100000:0.0:1788587161.798049:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+38:11392:x1875469292052864:12345-192.168.203.14@tcp:101:bash.0 Request processed in 19141us (19330us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788587161.798063:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:1.0:1788587161.803704:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.803789:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292053248 00000100:00100000:0.0:1788587161.803842:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292053248 00000100:00100000:0.0:1788587161.803905:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:0.0:1788587161.803915:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+38:11392:x1875469292053248:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:1.0:1788587161.804341:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.804362:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.804375:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587161.804428:0:6474:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1788587161.804481:0:6474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000307bc990 reply state 0000000034bc7442 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.805342:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.805352:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:1.0:1788587161.805355:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587161.805360:0:6474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587161.805669:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+41:11392:x1875469292053248:12345-192.168.203.14@tcp:36:bash.0 Request processed in 1752us (1972us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788587161.805690:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000020:00080000:1.0:1788587161.805696:0:6474:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788587161.821714:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.821875:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292053376 00000100:00100000:0.0:1788587161.821886:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292053376 00000100:00100000:0.0:1788587161.821949:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:0.0:1788587161.821959:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+41:11392:x1875469292053376:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587161.821981:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.822002:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd588b expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.822319:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.822336:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 42 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.822360:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.822395:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 42 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.822408:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 42 pid: 8126 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587161.822423:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309965952:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587161.822622:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587161.826039:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309965952:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587161.826071:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587161.829191:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.829756:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292053504 00000100:00100000:0.0:1788587161.829766:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292053504 00010000:00010000:0.0:1788587161.829841:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 43 pid: 8126 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587161.829886:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:0.0:1788587161.829896:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a738e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+43:2410:x1875469292053504:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587161.829911:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587161.829918:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 43 pid: 8126 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.829951:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 43 pid: 8126 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.829974:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5884 expref: 43 pid: 8126 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.829994:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587161.830000:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.830010:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.830018:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.830043:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587161.830116:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a738e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+42:2410:x1875469292053504:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 221us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.830134:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00010000:00010000:1.0:1788587161.831598:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.831612:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587161.831658:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788587161.831663:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587161.831683:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.831721:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd588b expref: 42 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.832024:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd588b expref: 41 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.832055:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:1.0:1788587161.832058:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587161.832062:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482200, rc 0) 00000100:00100000:1.0:1788587161.832136:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+41:11392:x1875469292053376:12345-192.168.203.14@tcp:101:bash.0 Request processed in 10177us (10431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587161.832145:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:1.0:1788587161.839984:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587161.840946:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292053760 00000100:00100000:3.0:1788587161.840958:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292053760 00000100:00100000:3.0:1788587161.841068:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788587161.841088:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+41:11392:x1875469292053760:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:3.0:1788587161.843840:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+42:11392:x1875469292053760:12345-192.168.203.14@tcp:35:bash.0 Request processed in 2753us (3857us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788587161.843853:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788587161.929346:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.929502:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292054016 00000100:00100000:0.0:1788587161.929513:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292054016 00000100:00100000:0.0:1788587161.929575:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:0.0:1788587161.929586:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+42:11402:x1875469292054016:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587161.929619:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.929639:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5892 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.929738:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788587161.929899:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5892 expref: 44 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.929914:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:0.0:1788587161.929917:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587161.929922:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5892 expref: 44 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.929939:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482a00, rc 0) 00000100:00100000:0.0:1788587161.929999:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+43:11402:x1875469292054016:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 415us (663us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788587161.930007:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:1.0:1788587161.938055:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587161.938374:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292054144 00000100:00100000:3.0:1788587161.938385:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292054144 00000100:00100000:3.0:1788587161.938451:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:3.0:1788587161.938462:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+43:11402:x1875469292054144:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:3.0:1788587161.938551:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.938569:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.938596:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.938615:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.938622:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.938628:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940023:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940040:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940051:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587161.940242:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940257:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940264:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940271:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940302:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587161.940307:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940315:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940329:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:3.0:1788587161.940332:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587161.940341:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940349:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343d6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940364:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940370:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940376:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940381:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587161.940384:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940390:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940408:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf02c76d00) 00010000:00010000:3.0:1788587161.940410:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587161.940413:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940419:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940436:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940442:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940447:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940451:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587161.940454:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940622:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940633:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587161.940636:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587161.940639:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.940645:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343d78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587161.940924:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+43:11402:x1875469292054144:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 2459us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587161.940933:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:1.0:1788587161.943934:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.944986:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292054400 00000100:00100000:0.0:1788587161.944999:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292054400 00000100:00100000:0.0:1788587161.945111:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:0.0:1788587161.945122:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+43:11402:x1875469292054400:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788587161.945655:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+44:11402:x1875469292054400:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 533us (1730us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788587161.945664:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:1.0:1788587161.985658:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.985919:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292054656 00000100:00100000:0.0:1788587161.985930:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292054656 00000100:00100000:0.0:1788587161.985994:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:0.0:1788587161.986005:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+44:11405:x1875469292054656:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587161.986029:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.986065:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5899 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986137:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986152:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986237:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986254:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986382:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986390:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986931:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343d94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986945:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.986952:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.986962:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788587161.987447:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987470:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987477:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987483:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587161.987552:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987562:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987576:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587161.987579:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.987584:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987592:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6343d86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987610:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987617:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987623:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987629:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587161.987638:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987646:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987654:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587161.987657:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.987660:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987667:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6343d8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.987992:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6343d7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5899 expref: 47 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.988013:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343d94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5899 expref: 46 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.988020:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587161.988023:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587161.988026:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482000, rc 0) 00000100:00100000:0.0:1788587161.988107:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+46:11405:x1875469292054656:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 2103us (2458us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788587161.988116:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:1.0:1788587161.991972:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587161.992018:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292054912 00000100:00100000:0.0:1788587161.992029:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292054912 00000100:00100000:0.0:1788587161.992092:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:0.0:1788587161.992102:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+46:11405:x1875469292054912:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:0.0:1788587161.992184:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992203:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992287:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992318:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992326:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992333:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992339:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587161.992343:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992351:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992363:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587161.992366:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587161.992371:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.992378:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343da2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587161.992462:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+46:11405:x1875469292054912:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 361us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.992469:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:1.0:1788587161.993042:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587161.993086:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292054784 00000100:00100000:2.0:1788587161.993094:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292054784 00000100:00100000:2.0:1788587161.993146:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788587161.993237:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+46:2410:x1875469292054784:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587161.993253:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587161.993351:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343d94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5899 expref: 46 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.993370:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:2.0:1788587161.993374:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587161.993408:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+45:2410:x1875469292054784:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 255us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587161.993415:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:1.0:1788587161.995678:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587161.995851:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292055168 00000100:00100000:3.0:1788587161.995862:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292055168 00000100:00100000:3.0:1788587161.995916:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788587161.995926:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+45:11405:x1875469292055168:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587161.996372:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+46:11405:x1875469292055168:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 445us (702us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788587161.996380:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00010000:00010000:3.0:1788587162.028753:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587162.218877:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587162.219421:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292055424 00000100:00100000:1.0:1788587162.219433:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292055424 00000100:00100000:1.0:1788587162.219505:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:1.0:1788587162.219523:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+46:11423:x1875469292055424:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:1.0:1788587162.219546:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587162.219567:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343da9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58a0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.219929:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343db0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.219945:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343db0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.219975:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343db0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587162.219988:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788587162.220116:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343da9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58a0 expref: 49 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.220135:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343db0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58a0 expref: 48 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.220145:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:1.0:1788587162.220148:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788587162.220152:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd000, rc 0) 00000100:00100000:1.0:1788587162.220223:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+48:11423:x1875469292055424:12345-192.168.203.14@tcp:101:cat.0 Request processed in 702us (1355us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1788587162.220231:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:1.0:1788587162.242007:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.242114:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292055552 00000100:00100000:0.0:1788587162.242124:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292055552 00000100:00100000:0.0:1788587162.242196:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 74 00000100:00100000:0.0:1788587162.242206:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+48:11424:x1875469292055552:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587162.242231:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587162.242253:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58a7 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.242413:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.242428:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.242441:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587162.242670:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788587162.242675:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587162.242696:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.242723:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58a7 expref: 50 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.242745:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58a7 expref: 49 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.242767:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587162.242770:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587162.242773:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482c00, rc 0) 00000100:00100000:0.0:1788587162.242999:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+49:11424:x1875469292055552:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 793us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.243007:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 74 00000100:00100000:2.0:1788587162.247297:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.247486:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292055936 00000100:00100000:0.0:1788587162.247502:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292055936 00000100:00100000:0.0:1788587162.247559:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:0.0:1788587162.247570:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+49:11424:x1875469292055936:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788587162.247978:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+50:11424:x1875469292055936:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 407us (687us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788587162.247985:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788587162.250772:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587162.251077:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292056064 00000100:00100000:2.0:1788587162.251087:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292056064 00000100:00100000:2.0:1788587162.251163:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788587162.251174:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+50:11424:x1875469292056064:12345-192.168.203.14@tcp:103:lfs.0 00010000:00010000:2.0:1788587162.251190:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788587162.251216:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6343d55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd588b expref: 50 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.251504:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6343db0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58a0 expref: 49 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.251521:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343c60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd584c expref: 48 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.251533:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:2.0:1788587162.251539:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587162.251602:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+47:11424:x1875469292056064:12345-192.168.203.14@tcp:103:lfs.0 Request processed in 429us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.251609:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788587162.254701:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.254823:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292056192 00000100:00100000:0.0:1788587162.254833:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292056192 00000100:00100000:0.0:1788587162.255001:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 75 00000100:00100000:0.0:1788587162.255012:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+47:11424:x1875469292056192:12345-192.168.203.14@tcp:58:lfs.0 00010000:00010000:0.0:1788587162.255136:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.255153:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.255167:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587162.255898:0:8126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587162.256076:0:8126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788587162.256127:0:8126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788587162.256240:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+47:11424:x1875469292056192:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 1226us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.256248:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 75 00000100:00100000:1.0:1788587162.285962:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587162.286116:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292056320 00000100:00100000:3.0:1788587162.286129:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292056320 00000100:00100000:3.0:1788587162.286200:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:3.0:1788587162.286211:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+47:11426:x1875469292056320:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587162.286235:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587162.286260:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343dd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58ae expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.286342:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.286359:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.286389:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.286406:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.286413:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.286420:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287054:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287066:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287075:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587162.287110:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788587162.287115:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587162.287133:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287145:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287153:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287174:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287179:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287184:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587162.287189:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287196:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287208:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:3.0:1788587162.287210:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587162.287215:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287221:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343dda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287234:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287240:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287245:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287250:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587162.287260:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287265:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287283:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf02c76d00) 00010000:00010000:3.0:1788587162.287286:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587162.287289:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287295:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343de1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287329:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343dd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 49 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287344:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 48 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.287352:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587162.287354:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587162.287358:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00031000, rc 0) 00000100:00100000:3.0:1788587162.287431:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+48:11426:x1875469292056320:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1220us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587162.287439:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 76 00000040:00080000:0.0:1788587162.731020:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587162.731029:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587162.731081:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788587162.731088:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587162.731226:0:13326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309966080:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587162.731330:0:13326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587162.736625:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587162.736661:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292056448 00000100:00100000:2.0:1788587162.736669:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292056448 00000100:00100000:2.0:1788587162.736730:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:2.0:1788587162.736740:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+49:11437:x1875469292056448:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1788587162.737081:0:13326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309966080:192.168.203.14@tcp:107:hsm_cdtr.0 00000004:00000080:2.0:1788587162.737311:0:13560:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587162.737414:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+48:11437:x1875469292056448:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 674us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.737421:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00000040:00080000:0.0:1788587162.741083:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587162.749384:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.754014:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292056576 00000100:00100000:0.0:1788587162.754027:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292056576 00000100:00100000:0.0:1788587162.754083:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:0.0:1788587162.754093:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+48:11437:x1875469292056576:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788587162.754196:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754213:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754224:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754289:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754308:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754315:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754341:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754349:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754355:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587162.754387:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788587162.754391:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587162.754403:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754412:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754419:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754426:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754433:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587162.754437:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754450:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754471:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:0.0:1788587162.754479:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587162.754485:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754491:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343def lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754505:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754511:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754518:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754522:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587162.754525:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754531:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754537:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587162.754539:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587162.754542:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754555:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343df6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754569:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754574:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754581:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754593:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587162.754596:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754602:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754610:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587162.754612:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587162.754614:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.754620:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343dfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587162.754695:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+48:11437:x1875469292056576:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 603us (5322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.754703:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:3.0:1788587162.769768:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587162.773060:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292056832 00000100:00100000:1.0:1788587162.773075:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292056832 00000100:00100000:1.0:1788587162.773157:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:1.0:1788587162.773168:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+48:11437:x1875469292056832:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587162.773188:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587162.773212:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343e04 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58b5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773339:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773355:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773367:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587162.773386:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788587162.773484:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773492:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773498:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773503:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587162.773507:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773514:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773526:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:1.0:1788587162.773529:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587162.773534:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773553:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343e0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773600:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343e04 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58b5 expref: 50 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773610:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:1.0:1788587162.773613:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587162.773616:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343e04 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58b5 expref: 50 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.773625:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc400, rc 0) 00000100:00100000:1.0:1788587162.773695:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+49:11437:x1875469292056832:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 528us (3936us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788587162.773703:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:3.0:1788587162.785588:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587162.785822:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292056960 00000100:00100000:1.0:1788587162.785833:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292056960 00000100:00100000:1.0:1788587162.785892:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:1.0:1788587162.785903:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+49:11437:x1875469292056960:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587162.785936:0:6474:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587162.786036:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+49:11437:x1875469292056960:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 135us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587162.786044:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:3.0:1788587162.789139:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587162.789311:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292057216 00000100:00100000:2.0:1788587162.789321:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292057216 00000100:00100000:2.0:1788587162.789371:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:2.0:1788587162.789381:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+49:11437:x1875469292057216:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587162.789399:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587162.789410:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788587162.789435:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343dc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58a7 expref: 49 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.789456:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587162.789462:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587162.789476:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343e19 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58bc expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587162.790004:0:6472:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788587162.790413:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343e20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.790428:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.790438:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.790496:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343e19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58bc expref: 51 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.790512:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58bc expref: 50 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.790520:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf03491100) 00010000:00010000:2.0:1788587162.790522:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587162.790525:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044e00, rc 0) 00000100:00100000:2.0:1788587162.790590:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+50:11437:x1875469292057216:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1210us (1459us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788587162.790608:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:3.0:1788587162.808748:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587162.808791:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292057472 00000100:00100000:3.0:1788587162.808816:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292057472 00000100:00100000:3.0:1788587162.808875:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:3.0:1788587162.808885:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+50:11437:x1875469292057472:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587162.808941:0:13560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587162.808968:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343e20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58bc expref: 50 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.808989:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf03491100) 00010000:00010000:3.0:1788587162.809000:0:13560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587162.809023:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809037:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809047:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809060:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809066:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809072:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809283:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809300:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809307:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809313:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587162.809317:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809325:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809335:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:3.0:1788587162.809337:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587162.809341:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809348:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343e2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809358:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809363:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809369:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809374:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587162.809382:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809388:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809396:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3fc1b203 (ffff8cbf02c76d00) 00010000:00010000:3.0:1788587162.809398:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587162.809401:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.809407:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343e35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3fc1b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.809488:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+49:11437:x1875469292057472:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 605us (750us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587162.809496:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:2.0:1788587162.827418:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.833018:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292057600 00000100:00100000:0.0:1788587162.833033:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292057600 00000100:00100000:0.0:1788587162.833123:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 83 00000100:00100000:0.0:1788587162.833133:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+49:11437:x1875469292057600:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587162.833152:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587162.833174:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58c3 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.833224:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.833238:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.833250:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.833364:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 51 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.833384:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 50 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.833392:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587162.833395:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587162.833398:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482000, rc 0) 00000100:00100000:0.0:1788587162.833467:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+50:11437:x1875469292057600:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 334us (6058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.834749:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 83 00000100:00100000:3.0:1788587162.837637:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.837846:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292057856 00000100:00100000:0.0:1788587162.837865:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292057856 00000100:00100000:0.0:1788587162.837942:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 84 00000100:00100000:0.0:1788587162.837951:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+50:11437:x1875469292057856:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587162.838055:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.838079:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.838090:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587162.840033:0:6472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788587162.840049:0:6472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360589254026ns, next at 361589250602ns, rc = 0 00000004:00010000:0.0:1788587162.840184:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e7888a5 reply state 00000000d50150b1 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.840211:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.840220:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587162.840223:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788587162.840227:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587162.840367:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+52:11437:x1875469292057856:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 2413us (2743us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788587162.840376:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 84 00000100:00100000:1.0:1788587162.852200:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587162.856139:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292057984 00000100:00100000:2.0:1788587162.856154:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292057984 00000100:00100000:2.0:1788587162.856242:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:2.0:1788587162.856254:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+52:11437:x1875469292057984:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587162.856289:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587162.856312:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58ca expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.856373:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 53 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.856575:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 53 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.856597:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:2.0:1788587162.856600:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587162.856604:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044a00, rc 0) 00000100:00100000:2.0:1788587162.856679:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+53:11437:x1875469292057984:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 427us (4505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.856685:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:3.0:1788587162.861860:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.861989:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292058112 00000100:00100000:0.0:1788587162.861999:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292058112 00000100:00100000:0.0:1788587162.862049:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:0.0:1788587162.862057:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2408:x1875469292058112:12345-192.168.203.14@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788587162.862102:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:0.0:1788587162.862134:0:8449:0:(genops.c:1385:class_connect()) connect: client 12266002-a8db-4050-aa6c-b9db12e6128d, cookie 0x419e1ae1f6343e58 00002000:00100000:0.0:1788587162.862144:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 12266002-a8db-4050-aa6c-b9db12e6128d/ffff8cbf12ef5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788587162.862166:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788587162.862399:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788587162.862428:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587162.862507:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2408:x1875469292058112:12345-192.168.203.14@tcp:8:lhsmtool_posix.0 Request processed in 449us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.862516:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:3.0:1788587162.864109:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.864637:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292058240 00000100:00100000:0.0:1788587162.864646:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292058240 00000100:00100000:0.0:1788587162.864714:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:0.0:1788587162.864791:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:0:x1875469292058240:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788587162.864984:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788587162.933192:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1788587162.933210:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000100:00100000:0.0:1788587162.933374:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:0:x1875469292058240:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 68645us (69264us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788587162.934240:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:0.0:1788587162.935713:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587162.935778:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292058496 00000100:00100000:3.0:1788587162.935787:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292058496 00000100:00100000:3.0:1788587162.935940:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788587162.935953:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+53:11437:x1875469292058496:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587162.936412:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+54:11437:x1875469292058496:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 460us (705us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788587162.936421:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788587162.944233:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587162.944839:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292058752 00000100:00100000:3.0:1788587162.944856:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292058752 00000100:00100000:3.0:1788587162.944916:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:3.0:1788587162.944928:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+54:11437:x1875469292058752:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587162.945039:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+54:11437:x1875469292058752:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 113us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587162.945047:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:3.0:1788587162.948962:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587162.949159:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292058880 00000100:00100000:2.0:1788587162.949182:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292058880 00000100:00100000:2.0:1788587162.949243:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 87 00000100:00100000:2.0:1788587162.949254:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+54:11437:x1875469292058880:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587162.949283:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587162.949302:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343e5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58d1 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.949372:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343e66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.949400:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343e66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.949413:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343e66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587162.949449:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587162.949470:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343e66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.949504:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6343e5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d1 expref: 56 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.949519:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343e66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d1 expref: 55 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.949528:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:2.0:1788587162.949531:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788587162.949534:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044c00, rc 0) 00000100:00100000:2.0:1788587162.949651:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+55:11437:x1875469292058880:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 391us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.949665:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 87 00000100:00100000:1.0:1788587162.972002:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.975382:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292059008 00000100:00100000:0.0:1788587162.975397:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292059008 00000100:00100000:2.0:1788587162.975602:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:2.0:1788587162.975614:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292059008:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587162.975631:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587162.975650:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58d8 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587162.975676:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac9a, blocks: 0x1 00010000:00010000:2.0:1788587162.975694:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1788587162.975699:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587162.975709:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 6 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.975728:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 6 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.975741:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044e00, rc 0) 00000100:00100000:2.0:1788587162.976480:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292059008:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 865us (4483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.976489:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:2.0:1788587162.980412:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587162.980495:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292059264 00000100:00100000:3.0:1788587162.980513:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292059264 00000100:00100000:3.0:1788587162.980562:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 88 00000100:00100000:3.0:1788587162.980571:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+55:11437:x1875469292059264:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587162.980679:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+55:11437:x1875469292059264:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587162.980687:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 88 00000100:00100000:3.0:1788587162.985054:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587162.985875:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292059392 00000100:00100000:0.0:1788587162.985887:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292059392 00000100:00100000:0.0:1788587162.985953:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:0.0:1788587162.985963:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:11437:x1875469292059392:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587162.985981:0:8100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587162.986002:0:8100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58df expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.986043:0:8100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.986052:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587162.986057:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587162.986062:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.986095:0:8100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.986108:0:8100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 7 pid: 8449 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587162.986122:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8100:1875469309966208:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587162.986639:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587162.994105:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8100:1875469309966208:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587162.994143:0:8100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.994168:0:8100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482c00, rc 0) 00000100:00100000:0.0:1788587162.994225:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:11437:x1875469292059392:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 8263us (9181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.994235:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:1.0:1788587162.998832:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587162.998979:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292059520 00000100:00100000:2.0:1788587162.998989:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292059520 00010000:00010000:2.0:1788587162.999039:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 7 pid: 8449 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.999095:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:2.0:1788587162.999104:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292059520:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587162.999121:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587162.999147:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 7 pid: 8449 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.999161:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 7 pid: 8449 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.999185:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe534c3/0x419e1ae1f6343e6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d8 expref: 7 pid: 8449 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.999201:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587162.999205:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587162.999214:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 6 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.999224:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 6 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.999262:0:6457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 6 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.999285:0:6457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6457:1875469309966336:192.168.203.14@tcp:105: 00000100:00100000:2.0:1788587162.999379:0:6457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3736b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587163.004193:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.004359:0:6457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6457:1875469309966336:192.168.203.14@tcp:105: 00000100:00100000:3.0:1788587163.004526:0:8107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292059648 00000100:00100000:3.0:1788587163.004534:0:8107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292059648 00002000:00100000:3.0:1788587163.004583:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8cbe03da0700 x1875469292059648/t0(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:479/0 lens 504/0 e 0 to 0 dl 1788587174 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587163.004593:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe03da0700 with x1875469292059648 ext(0->8) 00002000:00010000:3.0:1788587163.004598:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe03da0700 00000100:00100000:3.0:1788587163.004635:0:8107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788587163.004645:0:8107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292059648:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788587163.006635:0:8107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+9:2410:x1875469292059648:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 Request processed in 1984us (2446us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788587163.006661:0:8107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00002000:00100000:3.0:1788587163.006673:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8cbe03da0700 x1875469292059648/t4294967303(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:479/0 lens 504/448 e 0 to 0 dl 1788587174 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587163.006683:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe03da0700 with x1875469292059648 ext(0->8) 00002000:00010000:3.0:1788587163.006689:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe03da0700 00010000:00010000:2.0:1788587163.007052:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587163.007084:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2409:x1875469292059520:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 7979us (8259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587163.007092:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:3.0:1788587163.009288:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.009407:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292059776 00000100:00100000:2.0:1788587163.009415:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292059776 00000100:00100000:1.0:1788587163.009613:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 89 00000100:00100000:1.0:1788587163.009626:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+55:11437:x1875469292059776:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1788587163.009908:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587163.053328:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788587163.084312:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:3.0:1788587163.084325:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:3.0:1788587163.084400:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084413:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084422:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084429:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587163.084434:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084442:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084459:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587163.084462:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587163.084467:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084709:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343cde lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084730:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084736:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084742:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084746:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587163.084749:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084754:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084763:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587163.084765:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587163.084768:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084774:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6343d01 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084788:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084884:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084897:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084902:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cca00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587163.084905:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084911:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084920:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587163.084923:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587163.084925:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084931:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343d47 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084944:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084950:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084956:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084960:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587163.084963:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084977:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084986:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:3.0:1788587163.084988:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587163.084991:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.084997:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343e4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.085139:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309966464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788587163.085203:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788587163.085627:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788587163.085657:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf05232540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788587163.085661:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf343b9800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf052320c0 00000020:00080000:2.0:1788587163.085665:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf343b9600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe057e5000 00000001:00080000:2.0:1788587163.085678:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000020:00080000:2.0:1788587163.085701:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788587163.085841:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788587163.086304:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cdb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309966592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788587163.086351:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587163.086392:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309966464 00000100:00100000:2.0:1788587163.086398:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309966464 00000100:00100000:2.0:1788587163.086456:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309966592 00000100:00100000:2.0:1788587163.086460:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309966592 00000100:00100000:2.0:1788587163.086499:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587163.086508:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309966464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788587163.086847:0:8101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788587163.086851:0:8101:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788587162 00002000:00010000:2.0:1788587163.086853:0:8101:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788587163.086863:0:8101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788587162 -> 1788587162 00002000:00010000:2.0:1788587163.086865:0:8101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1788587163.086947:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587163.086951:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587163.087087:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469309966464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 579us (1883us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788587163.087095:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587163.087114:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587163.087121:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469309966592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788587163.087148:0:8101:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788587163.087172:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9bac97, atime: 0x6a9bac97, ctime: 0x6a9bac97, blocks: 0xb 00010000:00010000:2.0:1788587163.087180:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.087195:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1788587163.087199:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587163.087205:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.087220:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.087231:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.087239:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.087304:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788587163.088094:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+13:11437:x1875469292059776:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 78467us (78819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587163.088104:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 89 00000100:00100000:2.0:1788587163.088986:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469309966592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1862us (2631us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788587163.088996:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1788587163.089056:0:3475:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbf3cdb9180/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788587163.089063:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cdb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309966592:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788587163.090772:0:3474:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbf3cdbad80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788587163.090786:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309966464:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788587163.092989:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587163.093002:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.093106:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587163.093111:0:8117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.093122:0:8117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587163.093127:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:3.0:1788587163.093143:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587163.093160:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292059904 00000100:00100000:1.0:1788587163.093169:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292059904 00000100:00100000:1.0:1788587163.093215:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788587163.093224:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292059904:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788587163.093265:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ebe5a0c/0x419e1ae1f6343e7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.093310:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587163.093312:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587163.093314:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587163.138834:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292059904:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 45600us (45699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587163.138847:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00000001:00080000:1.0:1788587163.138881:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788587163.138891:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788587163.144558:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587163.144827:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292060160 00000100:00100000:3.0:1788587163.144837:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292060160 00000100:00100000:3.0:1788587163.144893:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:3.0:1788587163.144903:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+13:11437:x1875469292060160:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587163.144959:0:13560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587163.144985:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6343e66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58d1 expref: 13 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.145003:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:3.0:1788587163.145009:0:13560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587163.145037:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.145051:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.145062:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587163.145310:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1ef246f reply state 000000002007fe7e transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.145324:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.145346:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:3.0:1788587163.145349:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587163.145352:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587163.145439:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+14:11437:x1875469292060160:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 537us (901us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788587163.145447:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:3.0:1788587163.147897:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.148024:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292060288 00000100:00100000:2.0:1788587163.148033:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292060288 00000100:00100000:2.0:1788587163.148086:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788587163.148096:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292060288:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788587163.148342:0:8100:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788587163.148345:0:8100:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788587162 -> 1788587161 00002000:00010000:2.0:1788587163.148348:0:8100:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788587159 00002000:00010000:2.0:1788587163.148350:0:8100:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788587162 -> 1788587161 00002000:00010000:2.0:1788587163.148352:0:8100:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788587163.148403:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292060288:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 308us (514us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788587163.148410:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788587163.154249:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.154301:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292060544 00000100:00100000:0.0:1788587163.154310:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292060544 00000100:00100000:0.0:1788587163.154369:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:0.0:1788587163.154380:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+14:11437:x1875469292060544:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788587163.154446:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.154463:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 14 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.154483:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.154521:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 14 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.154535:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 14 pid: 8126 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.154549:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309966720:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587163.154650:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587163.157023:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309966720:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587163.157054:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587163.159663:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.159724:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292060672 00000100:00100000:2.0:1788587163.159733:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292060672 00010000:00010000:2.0:1788587163.159775:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 15 pid: 8126 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.159833:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:2.0:1788587163.159843:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+15:2409:x1875469292060672:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587163.159857:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587163.159864:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 15 pid: 8126 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.159885:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 15 pid: 8126 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.159906:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343e43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58c3 expref: 15 pid: 8126 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.159923:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:2.0:1788587163.159927:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.159937:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.159944:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.159972:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587163.160023:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+14:2409:x1875469292060672:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 181us (368us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587163.160026:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.160031:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00010000:00010000:1.0:1788587163.160034:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.160062:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.160075:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.160083:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.160088:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587163.160092:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.160100:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.160109:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:1.0:1788587163.160112:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788587163.160115:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.160121:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343e89 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587163.160224:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+13:11437:x1875469292060544:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 Request processed in 5845us (5982us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788587163.160232:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:0.0:1788587163.162349:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587163.162952:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292060800 00000100:00100000:1.0:1788587163.162961:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292060800 00000100:00100000:1.0:1788587163.163030:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:1.0:1788587163.163040:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2412:x1875469292060800:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788587163.163080:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.163105:0:8101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.163113:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587163.163118:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587163.163122:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.163157:0:8101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.163172:0:8101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 7 pid: 8100 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587163.163186:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8101:1875469309966848:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587163.163276:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587163.170067:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8101:1875469309966848:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587163.170092:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:3.0:1788587163.170099:0:8101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.170120:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292060928 00000100:00100000:2.0:1788587163.170126:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292060928 00010000:00010000:2.0:1788587163.170170:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 8 pid: 8100 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.170208:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:2.0:1788587163.170217:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2409:x1875469292060928:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587163.170242:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587163.170277:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 8 pid: 8100 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.170292:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 8 pid: 8100 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.170313:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343e74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58df expref: 8 pid: 8100 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.170329:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587163.170333:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587163.170339:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.170349:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.170379:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587163.170431:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292060928:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 213us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587163.170438:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00010000:00010000:3.0:1788587163.170493:0:8101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.170502:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.170525:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.170534:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.170542:0:8101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.170557:0:8101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587163.170561:0:8101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.170571:0:8101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.170585:0:8101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.170593:0:8101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0eb93aa/0x419e1ae1f6343e90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587163.170637:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292060800:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 7599us (8299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587163.170644:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:1.0:1788587163.174281:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.174375:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292061184 00000100:00100000:2.0:1788587163.174384:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292061184 00000100:00100000:2.0:1788587163.174438:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 92 00000100:00100000:2.0:1788587163.174452:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+13:11437:x1875469292061184:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587163.174752:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.174771:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.174782:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.175048:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.175060:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 14 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.175067:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.175099:0:6474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 14 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.175113:0:6474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 14 pid: 6474 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.175127:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309966976:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587163.175295:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3736b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587163.178673:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.178716:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292061312 00000100:00100000:0.0:1788587163.178737:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292061312 00010000:00010000:0.0:1788587163.178776:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 15 pid: 6474 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587163.178788:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309966976:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587163.178827:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00010000:00010000:3.0:1788587163.178897:0:6474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.178905:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+15:2410:x1875469292061312:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587163.178919:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587163.178925:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 15 pid: 6474 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.178938:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 15 pid: 6474 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.178958:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6343e51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ca expref: 15 pid: 6474 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.178970:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587163.178975:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.178985:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.178993:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.179028:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587163.179041:0:6474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.179047:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.179079:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+14:2410:x1875469292061312:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 175us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587163.179085:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000001:00080000:3.0:1788587163.179232:0:6474:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788587163.179387:0:6474:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788587163.179431:0:6474:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788587163.179503:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6474:1875469309967104:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788587163.179543:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587163.179568:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587163.179584:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309967104 00000100:00100000:3.0:1788587163.179588:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309967104 00000100:00100000:3.0:1788587163.179622:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587163.179629:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6474:x1875469309967104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788587163.179706:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6474:x1875469309967104:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587163.179712:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587163.179738:0:6474:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788587163.179743:0:6474:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbf3cdbad80, transno 4294967304 00000100:00100000:3.0:1788587163.179754:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6474:1875469309967104:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788587163.180402:0:6474:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788587163.180458:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6474:1875469309967232:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788587163.180504:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587163.180530:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587163.180627:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309967232 00000100:00100000:0.0:1788587163.180632:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309967232 00000100:00100000:0.0:1788587163.180663:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788587163.180670:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6474:x1875469309967232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788587163.180891:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6474:x1875469309967232:12345-0@lo:1000:mdt00_002.0 Request processed in 221us (386us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788587163.180898:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788587163.181308:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6474:1875469309967232:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788587163.181400:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181410:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181428:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181435:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587163.181439:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181447:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181463:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:3.0:1788587163.181466:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587163.181470:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181477:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f6343e9e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181506:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181513:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181519:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181525:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587163.181527:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181545:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181553:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:3.0:1788587163.181556:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587163.181559:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181564:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6343dcc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181587:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181600:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 17 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181608:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181634:0:6474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 17 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.181718:0:6474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 17 pid: 6473 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587163.181731:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03508000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309967360:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788587163.181820:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf41799240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587163.186466:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03508000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309967360:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587163.186504:0:6474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587163.187548:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.187714:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292061440 00000100:00100000:2.0:1788587163.187778:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292061440 00010000:00010000:2.0:1788587163.187837:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 18 pid: 6473 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.187866:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:2.0:1788587163.187875:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:2410:x1875469292061440:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587163.187965:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587163.187973:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 18 pid: 6473 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.187985:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 18 pid: 6473 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.188008:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf00031000/0x419e1ae1f6343de8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ae expref: 18 pid: 6473 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.188233:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:2.0:1788587163.188238:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.188248:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.188256:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.188301:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587163.188544:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+17:2410:x1875469292061440:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 605us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587163.188552:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00010000:00010000:0.0:1788587163.191690:0:6474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191708:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191724:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191732:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191740:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191745:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.191749:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191769:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191787:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587163.191790:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587163.191810:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191816:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343ea5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191829:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191834:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191839:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191843:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.191845:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191850:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191857:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf03491500) 00010000:00010000:0.0:1788587163.191859:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587163.191862:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.191876:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6343e97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.192116:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+16:11437:x1875469292061184:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 17663us (18099us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788587163.192126:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 92 00000020:00080000:0.0:1788587163.192132:0:6474:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788587163.193256:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587163.193263:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587163.193306:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788587163.193312:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587163.202514:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.203109:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292061696 00000100:00100000:0.0:1788587163.203120:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292061696 00000100:00100000:0.0:1788587163.203170:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:0.0:1788587163.203180:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+16:11437:x1875469292061696:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1788587163.203298:0:13751:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587163.203307:0:13751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587163.203345:0:13751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788587163.203350:0:13751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1788587163.205255:0:6476:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788587163.205384:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788587163.205450:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.205469:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.205482:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.205491:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.205498:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.205504:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.205536:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587163.205564:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587163.205576:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.205582:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587163.205586:0:8116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.205593:0:8116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.205605:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:1.0:1788587163.205608:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788587163.205613:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.205618:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343eac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.205629:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587163.205631:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587163.205633:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587163.205678:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+18:11437:x1875469292061696:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 2495us (3169us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788587163.205687:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000020:00080000:0.0:1788587163.205693:0:6476:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788587163.331459:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587163.331564:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292061952 00000100:00100000:1.0:1788587163.331575:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292061952 00000100:00100000:1.0:1788587163.331676:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:1.0:1788587163.331686:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+18:11448:x1875469292061952:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587163.331709:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587163.331728:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58e6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.331848:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343eba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.331875:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343eba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.331888:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343eba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587163.331901:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788587163.332015:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f6343eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58e6 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.332031:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343eba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58e6 expref: 20 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.332041:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:1.0:1788587163.332043:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587163.332047:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cca00, rc 0) 00000100:00100000:1.0:1788587163.332104:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+20:11448:x1875469292061952:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 419us (653us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788587163.332111:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:2.0:1788587163.334715:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.334878:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292062080 00000100:00100000:0.0:1788587163.334887:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292062080 00000100:00100000:0.0:1788587163.334966:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00100000:0.0:1788587163.334975:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+20:11448:x1875469292062080:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:0.0:1788587163.335040:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335056:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335066:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335080:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335086:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335093:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335309:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335325:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335333:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587163.335367:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335378:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335384:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335390:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335395:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.335399:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335406:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335417:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587163.335420:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587163.335425:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335431:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343ec8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335446:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335452:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335458:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335463:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.335466:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335472:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335480:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8be100) 00010000:00010000:0.0:1788587163.335483:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587163.335486:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335492:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ecf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335511:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335517:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335523:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335533:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.335536:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335543:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335551:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8bec00) 00010000:00010000:0.0:1788587163.335553:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587163.335556:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.335562:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343ed6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.335642:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+20:11448:x1875469292062080:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 667us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587163.335649:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00100000:3.0:1788587163.387101:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.387209:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292062336 00000100:00100000:0.0:1788587163.387221:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292062336 00000100:00100000:0.0:1788587163.387296:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 95 00000100:00100000:0.0:1788587163.387308:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+20:11451:x1875469292062336:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587163.387332:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587163.387353:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343edd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58ed expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387432:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387464:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387477:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387507:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387514:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387521:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387785:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387833:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387841:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587163.387851:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788587163.387946:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387955:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387962:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387974:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.387978:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387986:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.387998:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587163.388001:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587163.388006:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.388013:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343ee4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.388026:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.388031:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.388037:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.388042:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.388045:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.388051:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.388068:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8bec00) 00010000:00010000:0.0:1788587163.388070:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587163.388073:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.388080:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343eeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.388220:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343edd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 23 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.388239:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 22 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.388246:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:1.0:1788587163.388249:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587163.388259:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482c00, rc 0) 00000100:00100000:1.0:1788587163.388856:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+22:11451:x1875469292062336:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1547us (1763us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788587163.388866:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 95 00000100:00100000:1.0:1788587163.392345:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587163.392410:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292062464 00000100:00100000:3.0:1788587163.392423:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292062464 00000100:00100000:3.0:1788587163.392496:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:3.0:1788587163.392507:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+22:11451:x1875469292062464:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:3.0:1788587163.392575:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392590:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392602:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392628:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392635:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392643:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392648:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587163.392653:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392659:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392684:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:3.0:1788587163.392687:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587163.392691:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.392698:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343f00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587163.392780:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+22:11451:x1875469292062464:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 274us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587163.392787:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:2.0:1788587163.395336:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587163.395577:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292062720 00000100:00100000:1.0:1788587163.395588:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292062720 00000100:00100000:1.0:1788587163.395689:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:1.0:1788587163.395702:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+22:11451:x1875469292062720:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788587163.395966:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+23:11451:x1875469292062720:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 265us (636us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788587163.395974:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:1.0:1788587163.441091:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.441189:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292062976 00000100:00100000:0.0:1788587163.441200:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292062976 00000100:00100000:0.0:1788587163.441403:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 97 00000100:00100000:0.0:1788587163.441418:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+23:10977:x1875469292062976:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587163.441443:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587163.441466:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f07 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58f4 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.441582:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.441602:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 24 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.441611:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.441647:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 24 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.441661:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 24 pid: 6474 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.441689:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309967488:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587163.441787:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587163.444888:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309967488:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587163.444926:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587163.445463:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.446051:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292063104 00000100:00100000:0.0:1788587163.446059:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292063104 00010000:00010000:0.0:1788587163.446099:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 25 pid: 6474 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.446137:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:0.0:1788587163.446147:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+25:2409:x1875469292063104:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587163.446162:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587163.446170:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 25 pid: 6474 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.446182:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 25 pid: 6474 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.446203:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343ef2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58ed expref: 25 pid: 6474 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.446218:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:0.0:1788587163.446221:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.446367:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.446374:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.446412:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587163.446467:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+24:2409:x1875469292063104:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 321us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587163.446474:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00010000:00010000:2.0:1788587163.446617:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.446626:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587163.446645:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788587163.446791:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f07 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 25 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.446848:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 24 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.446855:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:2.0:1788587163.446858:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587163.446861:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482a00, rc 0) 00000100:00100000:2.0:1788587163.446887:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+24:10977:x1875469292062976:12345-192.168.203.14@tcp:101:bash.0 Request processed in 5473us (5806us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788587163.446895:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 97 00000100:00100000:3.0:1788587163.451211:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587163.451362:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292063360 00000100:00100000:1.0:1788587163.451372:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292063360 00000100:00100000:1.0:1788587163.451436:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 98 00000100:00100000:1.0:1788587163.451447:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+24:10977:x1875469292063360:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:1.0:1788587163.451737:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.451753:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.451765:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587163.451854:0:6474:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788587163.451894:0:6474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f59116c reply state 0000000004757cf5 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.451907:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587163.451914:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:1.0:1788587163.451917:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587163.451921:0:6474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788587163.451969:0:6474:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788587163.452881:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+28:10977:x1875469292063360:12345-192.168.203.14@tcp:36:bash.0 Request processed in 1433us (1678us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788587163.452891:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 98 00000020:00080000:1.0:1788587163.452897:0:6474:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788587163.455670:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.455752:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292063488 00000100:00100000:2.0:1788587163.455762:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292063488 00000100:00100000:2.0:1788587163.455963:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 99 00000100:00100000:2.0:1788587163.455974:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+28:10977:x1875469292063488:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587163.456015:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587163.456036:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f6343f23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd58fb expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.456097:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f6343f23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58fb expref: 29 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.456111:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f6343f23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58fb expref: 29 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.456127:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:2.0:1788587163.456130:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587163.456133:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062aec00, rc 0) 00000100:00100000:2.0:1788587163.456757:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+29:10977:x1875469292063488:12345-192.168.203.14@tcp:101:bash.0 Request processed in 782us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587163.456765:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 99 00000100:00100000:2.0:1788587163.460902:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.460996:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292063616 00000100:00100000:0.0:1788587163.461007:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292063616 00000100:00100000:0.0:1788587163.461070:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:0.0:1788587163.461079:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:10977:x1875469292063616:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587163.461097:0:8100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587163.461119:0:8100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5902 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587163.461156:0:8100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9bac99, atime: 0x6a9bac97, ctime: 0x6a9bac99, blocks: 0xb 00010000:00010000:0.0:1788587163.461178:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1788587163.461182:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587163.461190:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.461209:0:8100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.461244:0:8100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483c00, rc 0) 00000100:00100000:0.0:1788587163.461311:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:10977:x1875469292063616:12345-192.168.203.14@tcp:101:bash.0 Request processed in 232us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587163.461318:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:0.0:1788587163.463745:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.464073:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292063744 00000100:00100000:2.0:1788587163.464083:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292063744 00002000:00010000:2.0:1788587163.464120:0:8105:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788587163.464125:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf3bd53480 with x1875469292063744 ext(0->18446744073709551615) 00002000:00010000:2.0:1788587163.464135:0:8105:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbf3bd53480. 00000100:00100000:2.0:1788587163.464280:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:2.0:1788587163.464291:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292063744:12345-192.168.203.14@tcp:10:bash.0 00002000:00010000:2.0:1788587163.465118:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788587163.465124:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788587161 -> 1788587163 00002000:00010000:2.0:1788587163.465139:0:8105:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788587159 -> 1788587159 00002000:00010000:2.0:1788587163.465141:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788587161 -> 1788587163 00002000:00010000:2.0:1788587163.465259:0:8105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788587163.465378:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292063744:12345-192.168.203.14@tcp:10:bash.0 Request processed in 1086us (1641us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788587163.465388:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00002000:00010000:2.0:1788587163.465393:0:8105:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788587163.465397:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf3bd53480 with x1875469292063744 ext(0->18446744073709551615) 00002000:00010000:2.0:1788587163.465403:0:8105:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbf3bd53480. 00000100:00100000:1.0:1788587163.549315:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.549420:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292063872 00000100:00100000:2.0:1788587163.549430:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292063872 00000100:00100000:2.0:1788587163.549498:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:2.0:1788587163.549507:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+29:11465:x1875469292063872:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:2.0:1788587163.549582:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549598:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549609:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549622:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549628:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549633:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549917:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549927:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549935:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587163.549978:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549988:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.549995:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550001:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550007:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587163.550012:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550020:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550032:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587163.550035:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587163.550039:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550051:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550065:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550071:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550077:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550081:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587163.550084:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550090:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550097:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:2.0:1788587163.550099:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587163.550102:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550108:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550129:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550135:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550146:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550151:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587163.550154:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550159:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550167:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:2.0:1788587163.550169:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587163.550172:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.550176:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.550241:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+29:11465:x1875469292063872:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 734us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587163.550248:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:1.0:1788587163.595293:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.598845:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292064128 00000100:00100000:2.0:1788587163.598862:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292064128 00000100:00100000:2.0:1788587163.599561:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:2.0:1788587163.599580:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+29:11468:x1875469292064128:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587163.599605:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587163.599629:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5909 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.599717:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.599731:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.599743:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.599767:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.599774:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.599782:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.600670:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343f5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.600685:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.600693:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587163.600703:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788587163.601565:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601577:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601594:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601600:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587163.601604:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601612:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601624:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587163.601627:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587163.601632:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601638:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601651:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601658:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601664:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601669:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587163.601673:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601688:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601697:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:2.0:1788587163.601699:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587163.601703:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601709:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601765:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5909 expref: 32 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601779:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343f5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5909 expref: 31 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.601786:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:2.0:1788587163.601788:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788587163.601790:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062af800, rc 0) 00000100:00100000:2.0:1788587163.602463:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+31:11468:x1875469292064128:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 2885us (7175us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788587163.602473:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:1.0:1788587163.609732:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.609894:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292064256 00000100:00100000:2.0:1788587163.609903:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292064256 00000100:00100000:2.0:1788587163.609966:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00100000:2.0:1788587163.609977:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+31:11468:x1875469292064256:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:2.0:1788587163.610065:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.610086:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 31 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.610097:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.610130:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 31 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.610154:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 31 pid: 8126 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.610167:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309967616:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587163.610254:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3736bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587163.613677:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.613891:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292064512 00000100:00100000:0.0:1788587163.613900:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292064512 00000100:00100000:0.0:1788587163.613951:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:0.0:1788587163.613961:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+32:6381:x1875469292064512:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788587163.614314:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+33:6381:x1875469292064512:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 352us (644us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788587163.614322:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788587163.615201:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309967616:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587163.615229:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587163.618091:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.618190:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292064640 00000100:00100000:2.0:1788587163.618200:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292064640 00010000:00010000:2.0:1788587163.618242:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 33 pid: 8126 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587163.618289:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:2.0:1788587163.618299:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+33:2410:x1875469292064640:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587163.618326:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587163.618332:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 33 pid: 8126 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.618355:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 33 pid: 8126 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.618377:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f0e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58f4 expref: 33 pid: 8126 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.618393:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:2.0:1788587163.618399:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.618408:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.618416:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.618449:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587163.618508:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+32:2410:x1875469292064640:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 210us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587163.618515:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00010000:00010000:3.0:1788587163.618854:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.618863:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.618893:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.618900:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.618907:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.618912:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587163.618916:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.618930:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.618939:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:3.0:1788587163.618942:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587163.618945:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.618951:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6343f69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587163.619003:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+31:11468:x1875469292064256:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 9027us (9280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587163.619011:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00100000:1.0:1788587163.624129:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587163.624273:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292064896 00000100:00100000:3.0:1788587163.624284:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292064896 00000100:00100000:3.0:1788587163.624356:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:3.0:1788587163.624367:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+31:11468:x1875469292064896:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587163.624619:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+32:11468:x1875469292064896:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 252us (499us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788587163.624626:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:1.0:1788587163.729711:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.729838:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292065152 00000100:00100000:0.0:1788587163.729849:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292065152 00000100:00100000:0.0:1788587163.729913:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 103 00000100:00100000:0.0:1788587163.729924:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+32:11479:x1875469292065152:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:0.0:1788587163.729948:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587163.729970:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5910 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730040:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730053:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730081:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730095:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730102:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730108:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730361:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343f85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730370:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343f85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730377:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343f85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587163.730386:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788587163.730464:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730472:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730478:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730484:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.730494:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730502:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730514:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587163.730516:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587163.730521:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730527:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6343f77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730539:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730544:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730549:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730554:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587163.730557:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730564:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730571:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587163.730573:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587163.730583:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730589:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6343f7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730629:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6343f70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5910 expref: 35 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730643:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343f85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5910 expref: 34 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.730650:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:0.0:1788587163.730652:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587163.730654:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482000, rc 0) 00000100:00100000:0.0:1788587163.730717:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+34:11479:x1875469292065152:12345-192.168.203.14@tcp:101:cat.0 Request processed in 795us (1015us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788587163.730725:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 103 00000100:00100000:1.0:1788587163.735616:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587163.735728:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292065408 00000100:00100000:3.0:1788587163.735739:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292065408 00000100:00100000:3.0:1788587163.735836:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:3.0:1788587163.735849:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+34:11479:x1875469292065408:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:3.0:1788587163.736098:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+35:11479:x1875469292065408:12345-192.168.203.14@tcp:35:cat.0 Request processed in 252us (492us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788587163.736122:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:1.0:1788587163.772328:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.772639:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292065664 00000100:00100000:2.0:1788587163.772649:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292065664 00000100:00100000:2.0:1788587163.772706:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 104 00000100:00100000:2.0:1788587163.772715:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+35:11480:x1875469292065664:12345-192.168.203.14@tcp:36:rm.0 00010000:00010000:2.0:1788587163.772786:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788587163.772993:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6343f85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5910 expref: 35 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.773018:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343f5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5909 expref: 34 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.773030:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f6343f23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58fb expref: 33 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.773040:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:2.0:1788587163.773045:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587163.773073:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.773085:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.773095:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.773114:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.773121:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.773128:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.774146:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.774161:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.774170:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587163.775275:0:6474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:2.0:1788587163.775343:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775356:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775431:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775439:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775445:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775554:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775583:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587163.775610:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775630:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775640:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775648:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587163.775653:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775660:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775751:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:2.0:1788587163.775754:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788587163.775759:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775766:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae400/0x419e1ae1f6343fa1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775785:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.775792:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.776067:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.776072:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587163.776082:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.776089:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.776099:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587163.776101:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587163.776105:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.776111:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343f93 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587163.776123:0:6474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c7dee46 reply state 00000000bea44e50 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.776135:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.776141:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:2.0:1788587163.776144:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587163.776146:0:6474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587163.776240:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+34:11480:x1875469292065664:12345-192.168.203.14@tcp:36:rm.0 Request processed in 3521us (3917us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788587163.776249:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 104 00010000:00010000:3.0:1788587163.776772:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587163.776780:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.776787:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aea00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587163.776791:0:6460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.776840:0:6460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.776859:0:6460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:3.0:1788587163.776861:0:6460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788587163.776864:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.776873:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6343fa8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.776893:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587163.776895:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587163.776900:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587163.834086:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587163.834168:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292065920 00000100:00100000:3.0:1788587163.834179:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292065920 00000100:00100000:3.0:1788587163.834327:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 105 00000100:00100000:3.0:1788587163.834339:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+34:11486:x1875469292065920:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788587163.834365:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587163.834389:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343faf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5917 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.834543:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.834558:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.834569:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.834579:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.834586:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.834591:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587163.835593:0:13560:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788587163.835764:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.835781:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.835820:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.835854:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.835862:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.835868:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.835873:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587163.837038:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.837053:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.837067:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587163.837070:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587163.837076:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.837082:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6343fb6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587163.837100:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000874b1bd8 reply state 00000000310992de transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.837111:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.837131:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:2.0:1788587163.837133:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587163.837136:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788587163.837180:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6343faf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 37 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.837194:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 36 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.837201:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf03491a00) 00010000:00010000:2.0:1788587163.837203:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587163.837205:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae200, rc 0) 00000100:00100000:2.0:1788587163.837291:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+37:11486:x1875469292065920:12345-192.168.203.14@tcp:101:bash.0 Request processed in 2955us (3215us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788587163.837299:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 105 00000100:00100000:0.0:1788587163.843954:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587163.845571:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292066048 00000100:00100000:3.0:1788587163.845585:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292066048 00000100:00080000:1.0:1788587163.846388:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587163.846717:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:0.0:1788587163.846730:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf367df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292066048:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587163.846749:0:8099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587163.846772:0:8099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd591e expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587163.846812:0:8099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587163.846832:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1788587163.846837:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587163.846859:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 6 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.846881:0:8099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 6 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.846895:0:8099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483400, rc 0) 00000100:00100000:0.0:1788587163.846959:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf367df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292066048:12345-192.168.203.14@tcp:101:bash.0 Request processed in 231us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587163.846967:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:1.0:1788587163.850739:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.850883:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292066176 00000100:00100000:0.0:1788587163.850894:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292066176 00000100:00100000:0.0:1788587163.850955:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:0.0:1788587163.850966:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:11486:x1875469292066176:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587163.850986:0:8100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587163.851007:0:8100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5925 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.851042:0:8100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 7 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.851052:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587163.851056:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587163.851062:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.851095:0:8100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 7 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.851123:0:8100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 7 pid: 8099 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587163.851138:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8100:1875469309967744:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587163.851678:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587163.856001:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.856114:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8100:1875469309967744:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587163.856171:0:8100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 7 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587163.856190:0:8100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482c00, rc 0) 00000100:00100000:0.0:1788587163.856255:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:11486:x1875469292066176:12345-192.168.203.14@tcp:101:bash.0 Request processed in 5290us (5527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587163.856273:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:3.0:1788587163.856884:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292066304 00000100:00100000:3.0:1788587163.856892:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292066304 00010000:00010000:3.0:1788587163.856929:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 7 pid: 8099 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587163.856970:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:3.0:1788587163.856978:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292066304:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587163.856992:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587163.857014:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 7 pid: 8099 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.857041:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 7 pid: 8099 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.857062:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6343fd2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd591e expref: 7 pid: 8099 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.857076:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587163.857080:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587163.857088:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 6 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.857098:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 6 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587163.857132:0:6458:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 6 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587163.857146:0:6458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6458:1875469309967872:192.168.203.14@tcp:105: 00000100:00100000:3.0:1788587163.857380:0:6458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587163.862637:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587163.862743:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292066560 00000100:00100000:0.0:1788587163.862752:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292066560 00000100:00100000:0.0:1788587163.862836:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:0.0:1788587163.862847:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+37:11486:x1875469292066560:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:0.0:1788587163.863191:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+38:11486:x1875469292066560:12345-192.168.203.14@tcp:35:bash.0 Request processed in 345us (562us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788587163.863199:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788587163.864363:0:6458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6458:1875469309967872:192.168.203.14@tcp:105: 00010000:00010000:3.0:1788587163.864389:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587163.864450:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292066304:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 7471us (8456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587163.864460:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:1.0:1788587163.993782:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587163.994191:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292066688 00000100:00100000:2.0:1788587163.994201:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292066688 00000100:00100000:2.0:1788587163.994272:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 106 00000100:00100000:2.0:1788587163.994284:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+38:11501:x1875469292066688:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587163.994308:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587163.994330:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f6343fe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd592c expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.994397:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343fe7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.994413:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.994451:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587163.994658:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788587163.994663:0:6472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587163.994679:0:6472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.994701:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f6343fe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd592c expref: 40 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.994718:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd592c expref: 39 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587163.994727:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587163.994730:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587163.994733:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062af800, rc 0) 00000100:00100000:2.0:1788587163.994850:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+39:11501:x1875469292066688:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 568us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587163.994862:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 106 00000100:00100000:1.0:1788587164.001386:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.001492:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292066944 00000100:00100000:2.0:1788587164.001503:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292066944 00000100:00100000:2.0:1788587164.001567:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 107 00000100:00100000:2.0:1788587164.001578:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+39:11501:x1875469292066944:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587164.001599:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587164.001623:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6343fee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5933 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.001758:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f6343ff5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.001773:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f6343ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.001785:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f6343ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587164.001827:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788587164.001971:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6343fee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5933 expref: 42 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.001991:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f6343ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5933 expref: 41 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.002000:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf03491a00) 00010000:00010000:2.0:1788587164.002003:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587164.002006:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae000, rc 0) 00000100:00100000:2.0:1788587164.002058:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+41:11501:x1875469292066944:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 482us (681us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788587164.002066:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 107 00000100:00100000:1.0:1788587164.006018:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587164.006062:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.006317:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292067200 00000100:00100000:0.0:1788587164.006327:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292067200 00000100:00100000:0.0:1788587164.006404:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788587164.006414:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+41:2411:x1875469292067200:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587164.007371:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587164.007400:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f6343ff5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5933 expref: 41 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.007432:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf03491a00) 00010000:00010000:0.0:1788587164.007438:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587164.007503:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+40:2411:x1875469292067200:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 1089us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.007511:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788587164.007701:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292067328 00000100:00100000:2.0:1788587164.007708:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292067328 00000100:00100000:2.0:1788587164.007752:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 108 00000100:00100000:2.0:1788587164.007760:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+40:11501:x1875469292067328:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587164.007779:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587164.007825:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f6344003 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd593a expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.007913:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634400a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.007927:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634400a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.007937:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634400a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587164.007949:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788587164.008062:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f6344003 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd593a expref: 43 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.008075:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634400a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd593a expref: 42 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.008082:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf03491a00) 00010000:00010000:2.0:1788587164.008085:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587164.008087:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062af400, rc 0) 00000100:00100000:2.0:1788587164.008113:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+42:11501:x1875469292067328:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 355us (2052us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788587164.008119:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 108 00000100:00100000:1.0:1788587164.023223:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587164.023381:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292067456 00000100:00100000:3.0:1788587164.023391:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292067456 00000100:00100000:3.0:1788587164.023454:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:3.0:1788587164.023463:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292067456:12345-192.168.203.14@tcp:1:lfs.0 00010000:00010000:3.0:1788587164.023512:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.023534:0:8101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 6 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.023543:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587164.023547:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587164.023552:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.023585:0:8101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 6 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.023598:0:8101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 6 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587164.023613:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8101:1875469309968000:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788587164.023705:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587164.028036:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8101:1875469309968000:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788587164.028071:0:8101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587164.030226:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587164.030362:0:8107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292067584 00000100:00100000:3.0:1788587164.030373:0:8107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292067584 00002000:00100000:3.0:1788587164.030434:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8cbf3cc5ce00 x1875469292067584/t0(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:480/0 lens 504/0 e 0 to 0 dl 1788587175 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587164.030447:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf3cc5ce00 with x1875469292067584 ext(0->8) 00010000:00010000:3.0:1788587164.030457:0:8107:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 7 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.030474:0:8107:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 7 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587164.030488:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbf3cc5ce00 00000100:00100000:3.0:1788587164.030522:0:8107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:3.0:1788587164.030532:0:8107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292067584:12345-192.168.203.14@tcp:4:lfs.0 00000100:00100000:3.0:1788587164.031038:0:8107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+9:2409:x1875469292067584:12345-192.168.203.14@tcp:4:lfs.0 Request processed in 505us (830us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788587164.031046:0:8107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00002000:00100000:3.0:1788587164.031055:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8cbf3cc5ce00 x1875469292067584/t4294967303(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:480/0 lens 504/448 e 0 to 0 dl 1788587175 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587164.031064:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf3cc5ce00 with x1875469292067584 ext(0->8) 00010000:00010000:3.0:1788587164.031069:0:8107:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 9 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.031093:0:8107:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 9 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587164.031101:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbf3cc5ce00 00000100:00100000:1.0:1788587164.043936:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587164.044119:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292067712 00000100:00100000:3.0:1788587164.044129:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292067712 00010000:00010000:3.0:1788587164.044182:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 9 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587164.044230:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:3.0:1788587164.044249:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+9:2410:x1875469292067712:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587164.044274:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788587164.044292:0:6458:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788587164.044295:0:6458:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788587163 00002000:00010000:3.0:1788587164.044297:0:6458:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788587163 00002000:00010000:3.0:1788587164.044299:0:6458:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788587163 00010000:00010000:3.0:1788587164.044305:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 9 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.044318:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 9 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.044341:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6343fd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5925 expref: 9 pid: 8100 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.044378:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587164.044383:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587164.044390:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.044400:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.044451:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587164.044644:0:8101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.044655:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.044682:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.044691:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.044699:0:8101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.044707:0:8101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587164.044712:0:8101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.044729:0:8101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.044742:0:8101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.044750:0:8101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344018 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587164.046354:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292067712:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 2096us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587164.046367:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:0.0:1788587164.054498:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292067456:12345-192.168.203.14@tcp:1:lfs.0 Request processed in 31023us (31285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.054513:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:2.0:1788587164.058184:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587164.058737:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292067968 00000100:00100000:1.0:1788587164.058748:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292067968 00000100:00100000:1.0:1788587164.058888:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:1.0:1788587164.058900:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+42:11501:x1875469292067968:12345-192.168.203.14@tcp:35:lfs.0 00000004:00010000:1.0:1788587164.058959:0:6476:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634400a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd593a expref: 42 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587164.059200:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788587164.059257:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788587164.059567:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1788587164.059630:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.059646:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 46 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.059656:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.059691:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 46 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.059706:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 46 pid: 13560 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587164.059738:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6476:1875469309968128:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587164.059845:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587164.069358:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.069488:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6476:1875469309968128:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587164.069516:0:6476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587164.072685:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292068096 00000100:00100000:2.0:1788587164.072701:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292068096 00010000:00010000:2.0:1788587164.072831:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 47 pid: 13560 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587164.072953:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:2.0:1788587164.072964:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+47:2410:x1875469292068096:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587164.072978:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587164.072985:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 47 pid: 13560 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.072998:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 47 pid: 13560 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.073019:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6343fc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5917 expref: 47 pid: 13560 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.073036:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf03491a00) 00010000:00010000:2.0:1788587164.073041:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.073051:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.073059:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.073094:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587164.073167:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+46:2410:x1875469292068096:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 204us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.073175:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00010000:00010000:0.0:1788587164.075597:0:6476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.075613:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587164.075741:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1788587164.075984:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788587164.076103:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309968256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587164.076173:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587164.076889:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587164.076914:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309968256 00000100:00100000:0.0:1788587164.076921:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309968256 00000100:00100000:0.0:1788587164.076960:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788587164.076968:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6476:x1875469309968256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587164.077044:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6476:x1875469309968256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 75us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.077050:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788587164.077093:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309968256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788587164.077878:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788587164.077963:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309968384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587164.078004:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587164.078027:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587164.078046:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309968384 00000100:00100000:0.0:1788587164.078051:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309968384 00000100:00100000:0.0:1788587164.078079:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788587164.078087:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6476:x1875469309968384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587164.078537:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6476:x1875469309968384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 451us (532us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788587164.078546:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788587164.078587:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309968384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788587164.078637:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788587164.078674:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.078684:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.078705:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.078712:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587164.078716:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.078725:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.082457:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf03491a00) 00010000:00010000:0.0:1788587164.082461:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788587164.082469:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.082477:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f634401f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587164.083385:0:6476:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788587164.083498:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788587164.083510:0:6476:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361832715010ns, next at 362832712324ns, rc = 0 00000001:00080000:0.0:1788587164.083520:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788587164.083586:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf03491a00) 00010000:00010000:0.0:1788587164.083590:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788587164.083600:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634400a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd593a expref: 50 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587164.083720:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+49:11501:x1875469292067968:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 24821us (25543us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788587164.083742:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000020:00080000:0.0:1788587164.083749:0:6476:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:2.0:1788587164.087338:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587164.088478:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.088550:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292068224 00000100:00100000:0.0:1788587164.088560:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292068224 00000100:00100000:0.0:1788587164.088624:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 109 00000100:00100000:0.0:1788587164.088634:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+49:11501:x1875469292068224:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587164.088657:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587164.088682:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344026 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5941 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.088748:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344026 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5941 expref: 50 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.088777:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344026 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5941 expref: 50 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.088842:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587164.088846:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587164.088850:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482c00, rc 0) 00000100:00100000:0.0:1788587164.089832:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+50:11501:x1875469292068224:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1194us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.089843:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 109 00000100:00100000:3.0:1788587164.105479:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.110715:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292068480 00000100:00100000:0.0:1788587164.110731:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292068480 00000100:00100000:0.0:1788587164.110855:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:0.0:1788587164.110867:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+50:11501:x1875469292068480:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788587164.111220:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+51:11501:x1875469292068480:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 342us (5747us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788587164.111228:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788587164.191941:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.193517:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292068608 00000100:00100000:0.0:1788587164.193534:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292068608 00000100:00100000:0.0:1788587164.193615:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:0.0:1788587164.193625:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+51:11512:x1875469292068608:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:0.0:1788587164.193720:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.193738:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.193750:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.193763:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.193770:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.193776:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.193912:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.193921:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.193947:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587164.193996:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194010:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194016:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194023:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194029:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587164.194034:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194042:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194054:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587164.194057:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587164.194062:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194069:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634402d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194084:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194096:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194102:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194107:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587164.194110:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194117:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194125:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:0.0:1788587164.194127:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587164.194130:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194136:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194146:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194152:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194157:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194163:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587164.194173:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194179:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194187:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587164.194189:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587164.194192:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.194198:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f634403b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587164.194297:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+51:11512:x1875469292068608:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 672us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.194306:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:1.0:1788587164.236911:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.236980:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292068864 00000100:00100000:0.0:1788587164.236991:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292068864 00000100:00100000:0.0:1788587164.237057:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00100000:0.0:1788587164.237069:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+51:11515:x1875469292068864:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587164.237089:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587164.237111:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344042 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5948 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237186:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237202:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237234:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237247:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237254:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237271:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237400:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237409:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237416:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587164.237425:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788587164.237521:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237529:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237536:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237542:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587164.237553:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237561:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237573:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587164.237576:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587164.237580:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237586:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344049 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237599:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237604:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237610:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237614:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587164.237617:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237622:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237629:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:0.0:1788587164.237631:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587164.237641:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237647:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f6344050 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237694:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344042 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 54 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237709:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 53 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.237716:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587164.237718:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587164.237721:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482c00, rc 0) 00000100:00100000:0.0:1788587164.237911:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+53:11515:x1875469292068864:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 843us (1009us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788587164.237919:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00100000:3.0:1788587164.242019:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.242087:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292068992 00000100:00100000:2.0:1788587164.242099:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292068992 00000100:00100000:2.0:1788587164.242166:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:2.0:1788587164.242178:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+53:11515:x1875469292068992:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:2.0:1788587164.242251:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242281:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242295:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242332:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242340:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242347:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242353:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587164.242357:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242365:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242377:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587164.242380:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587164.242385:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.242405:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344065 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587164.242493:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+53:11515:x1875469292068992:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 317us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.242501:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:3.0:1788587164.247451:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.249021:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292069248 00000100:00100000:0.0:1788587164.249036:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292069248 00000100:00100000:0.0:1788587164.249099:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:0.0:1788587164.249110:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+53:11515:x1875469292069248:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788587164.249365:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+54:11515:x1875469292069248:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 256us (1924us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788587164.249373:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:1.0:1788587164.311557:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.311705:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292069504 00000100:00100000:2.0:1788587164.311715:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292069504 00000100:00100000:2.0:1788587164.311778:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 113 00000100:00100000:2.0:1788587164.311787:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+54:11525:x1875469292069504:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587164.311832:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587164.311836:0:13560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788587164.311864:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6343fe7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd592c expref: 54 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.311883:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587164.311888:0:13560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587164.311900:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f634406c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd594f expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.311989:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.312003:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 54 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.312011:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.312069:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 54 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.312084:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 54 pid: 6472 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587164.312098:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309968512:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587164.312188:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3736be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587164.315011:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.315217:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309968512:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587164.315246:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587164.315330:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292069632 00000100:00100000:1.0:1788587164.315337:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292069632 00010000:00010000:1.0:1788587164.315376:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 55 pid: 6472 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587164.315417:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:1.0:1788587164.315427:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+55:2409:x1875469292069632:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587164.315443:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587164.315450:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 55 pid: 6472 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.315464:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 55 pid: 6472 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.315487:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f6344057 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5948 expref: 55 pid: 6472 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.315504:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:1.0:1788587164.315508:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.315531:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.315539:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.315611:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587164.315674:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+54:2409:x1875469292069632:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 247us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587164.315681:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00010000:00010000:3.0:1788587164.319022:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.319041:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587164.319137:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788587164.319322:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f634406c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 55 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.319364:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 54 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587164.319373:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:3.0:1788587164.319376:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587164.319379:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae800, rc 0) 00000100:00100000:3.0:1788587164.319501:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+54:11525:x1875469292069504:12345-192.168.203.14@tcp:101:bash.0 Request processed in 7714us (7952us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788587164.319510:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 113 00000100:00100000:3.0:1788587164.326947:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.327057:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292069888 00000100:00100000:0.0:1788587164.327066:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292069888 00000100:00100000:0.0:1788587164.327129:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:0.0:1788587164.327140:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+54:11525:x1875469292069888:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:0.0:1788587164.327437:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.327455:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.327467:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587164.327526:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1788587164.327562:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecafd3be reply state 00000000d49e9bca transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.327573:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.327580:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587164.327583:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587164.327586:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587164.327673:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+57:11525:x1875469292069888:12345-192.168.203.14@tcp:36:bash.0 Request processed in 535us (736us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788587164.327681:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 114 00000020:00080000:0.0:1788587164.327686:0:6472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788587164.331071:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.331374:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292070016 00000100:00100000:0.0:1788587164.331384:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292070016 00000100:00100000:0.0:1788587164.331444:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:0.0:1788587164.331455:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+57:11525:x1875469292070016:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587164.331486:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587164.331508:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344088 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5956 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.331613:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.331628:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 58 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.331637:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.331672:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 58 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.331686:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 58 pid: 13560 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587164.331701:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6473:1875469309968640:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587164.331891:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bc1a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587164.335549:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.335833:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6473:1875469309968640:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587164.335876:0:6473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587164.336292:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292070144 00000100:00100000:2.0:1788587164.336301:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292070144 00010000:00010000:2.0:1788587164.336339:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 59 pid: 13560 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587164.336419:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:2.0:1788587164.336430:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+59:2410:x1875469292070144:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587164.336444:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587164.336451:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 59 pid: 13560 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.336464:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 59 pid: 13560 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.336513:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344073 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd594f expref: 59 pid: 13560 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.336528:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587164.336533:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.336543:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.336550:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.336579:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587164.336632:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+58:2410:x1875469292070144:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 204us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.336640:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 70 00010000:00010000:0.0:1788587164.337286:0:6473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.337296:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587164.337341:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788587164.337351:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587164.337374:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.337408:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344088 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 58 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.337426:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 57 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.337434:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587164.337436:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587164.337439:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482e00, rc 0) 00000100:00100000:0.0:1788587164.337492:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+57:11525:x1875469292070016:12345-192.168.203.14@tcp:101:bash.0 Request processed in 6039us (6431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.337499:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:3.0:1788587164.341611:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.341688:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292070400 00000100:00100000:0.0:1788587164.341698:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292070400 00000100:00100000:0.0:1788587164.341771:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:0.0:1788587164.341782:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+57:11525:x1875469292070400:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:0.0:1788587164.342081:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+58:11525:x1875469292070400:12345-192.168.203.14@tcp:35:bash.0 Request processed in 297us (477us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788587164.342089:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:3.0:1788587164.393537:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.393613:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292070528 00000100:00100000:2.0:1788587164.393625:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292070528 00000100:00100000:2.0:1788587164.394304:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:2.0:1788587164.394318:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+58:11531:x1875469292070528:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587164.394342:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587164.394362:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd595d expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.394426:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f634409d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.394457:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f634409d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.394469:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f634409d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587164.394506:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788587164.394510:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587164.394528:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f634409d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.394553:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd595d expref: 60 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.394573:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f634409d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd595d expref: 59 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.394581:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587164.394584:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587164.394588:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae600, rc 0) 00000100:00100000:2.0:1788587164.394671:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+59:11531:x1875469292070528:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 357us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.394679:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:3.0:1788587164.403406:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.403854:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292070656 00000100:00100000:2.0:1788587164.403864:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292070656 00000100:00100000:2.0:1788587164.403919:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:2.0:1788587164.403999:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+59:11531:x1875469292070656:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587164.404021:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587164.404243:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5964 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.404318:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.404333:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.404346:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.404358:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.404365:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.404918:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405219:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405230:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405237:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587164.405282:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788587164.405287:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587164.405306:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405330:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405339:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405345:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405351:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405356:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afe00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587164.405360:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405378:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405391:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587164.405394:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587164.405399:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405405:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63440ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405417:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405423:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405436:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405441:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587164.405444:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405450:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405459:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:2.0:1788587164.405461:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587164.405464:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405469:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63440b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405606:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5964 expref: 61 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405618:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5964 expref: 60 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.405625:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587164.405627:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587164.405629:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae800, rc 0) 00000100:00100000:2.0:1788587164.405701:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+60:11531:x1875469292070656:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1773us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.405850:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:3.0:1788587164.413837:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587164.413878:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587164.413953:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292070912 00000100:00100000:0.0:1788587164.413962:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292070912 00000100:00100000:2.0:1788587164.414005:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292071040 00000100:00100000:2.0:1788587164.414009:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292071040 00000100:00100000:0.0:1788587164.414025:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:0.0:1788587164.414034:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+61:11531:x1875469292070912:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587164.414053:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788587164.414063:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788587164.414070:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+61:2411:x1875469292071040:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587164.414081:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587164.414087:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f63440c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd596b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.414100:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5964 expref: 62 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.414116:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587164.414120:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587164.414164:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+61:2411:x1875469292071040:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 94us (376us total) trans 0 rc 0/0 00010000:00010000:0.0:1788587164.414174:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.414199:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 61 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.414207:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.414238:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 61 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.414255:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 61 pid: 6473 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587164.414283:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6473:1875469309968768:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587164.414331:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bc1a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587164.414617:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788587164.424931:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6473:1875469309968768:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587164.424968:0:6473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587164.425889:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.426856:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292071168 00000100:00100000:2.0:1788587164.426868:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292071168 00010000:00010000:2.0:1788587164.426922:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 61 pid: 6473 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587164.427016:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:2.0:1788587164.427028:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+61:2410:x1875469292071168:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587164.427043:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587164.427050:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 61 pid: 6473 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.427064:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 61 pid: 6473 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.427099:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f634408f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5956 expref: 61 pid: 6473 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.427118:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587164.427124:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.427134:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.427142:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.427184:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587164.427246:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+60:2410:x1875469292071168:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 221us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.427254:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 71 00010000:00010000:0.0:1788587164.427326:0:6473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.427334:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587164.427364:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788587164.427528:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f63440c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 61 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.427544:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 60 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587164.427552:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587164.427555:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587164.427558:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482c00, rc 0) 00000100:00100000:0.0:1788587164.427590:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+60:11531:x1875469292070912:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 13558us (13712us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788587164.427597:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:3.0:1788587164.431386:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587164.431479:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292071424 00000100:00100000:1.0:1788587164.431497:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292071424 00000100:00100000:1.0:1788587164.431599:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788587164.431611:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+60:11531:x1875469292071424:12345-192.168.203.14@tcp:103:lfs.0 00010000:00010000:1.0:1788587164.431626:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587164.431651:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344026 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5941 expref: 60 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587164.431670:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:1.0:1788587164.431674:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587164.431730:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+59:11531:x1875469292071424:12345-192.168.203.14@tcp:103:lfs.0 Request processed in 121us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587164.431738:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:3.0:1788587164.436294:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.437124:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292071552 00000100:00100000:2.0:1788587164.437134:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292071552 00000100:00100000:2.0:1788587164.437237:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:2.0:1788587164.437248:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+59:11531:x1875469292071552:12345-192.168.203.14@tcp:58:lfs.0 00010000:00010000:2.0:1788587164.437358:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.437375:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.437387:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587164.437715:0:13560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788587164.437828:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+59:11531:x1875469292071552:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 580us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.437837:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:3.0:1788587164.440163:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587164.440317:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292071680 00000100:00100000:2.0:1788587164.440325:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292071680 00000100:00100000:2.0:1788587164.440375:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:2.0:1788587164.440385:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+59:11531:x1875469292071680:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587164.440403:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587164.440423:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5972 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.440654:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.440666:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5972 expref: 60 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.440685:0:6474:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.440698:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5972 expref: 60 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.440710:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587164.440712:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587164.440716:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5972 expref: 60 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587164.440732:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062af200, rc 0) 00000100:00100000:2.0:1788587164.440788:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+60:11531:x1875469292071680:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 404us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.440823:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:2.0:1788587164.715900:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309969024:0@lo:400:kworker.0 00000100:00100000:1.0:1788587164.715978:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309969152:0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.715983:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309969280:0@lo:400:kworker.0 00000100:00100000:2.0:1788587164.715987:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587164.716061:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309968896:0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721104:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587164.721187:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309969792:0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721234:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587164.721253:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309970304:0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721284:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587164.721334:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309969792 00000100:00100000:0.0:1788587164.721341:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309969792 00000100:00100000:0.0:1788587164.721400:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309970304 00000100:00100000:0.0:1788587164.721403:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309970304 00000100:00100000:0.0:1788587164.721425:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587164.721434:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309969792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721508:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309969792:12345-0@lo:400:kworker.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.721515:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587164.721531:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788587164.721537:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309970304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721564:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309970304:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.721569:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788587164.721605:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309969792:0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721615:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309970304:0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721646:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309969024 00000100:00100000:0.0:1788587164.721650:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309969024 00000100:00100000:0.0:1788587164.721677:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309969280 00000100:00100000:0.0:1788587164.721680:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309969280 00000100:00100000:0.0:1788587164.721697:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788587164.721703:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309969024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721736:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309969024:12345-0@lo:400:kworker.0 Request processed in 33us (5754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.721741:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788587164.721751:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788587164.721756:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309969280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.721786:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309969280:12345-0@lo:400:kworker.0 Request processed in 29us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.721811:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788587164.721837:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309969280:0@lo:400:kworker.0 00000100:00080000:0.0:1788587164.721884:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587164.721888:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587164.732394:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587164.732470:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3ab9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309969664:0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.732644:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309969152 00000100:00100000:0.0:1788587164.732655:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309969152 00000100:00100000:1.0:1788587164.732908:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587164.732941:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309970176:0@lo:400:kworker.0 00000100:00100000:1.0:1788587164.732965:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587164.733005:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309969664 00000100:00100000:1.0:1788587164.733008:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309969664 00000100:00100000:1.0:1788587164.733049:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309970176 00000100:00100000:1.0:1788587164.733052:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309970176 00000100:00100000:1.0:1788587164.733076:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788587164.733085:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309969664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.733234:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788587164.733244:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309969152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.733305:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309969152:12345-0@lo:400:kworker.0 Request processed in 63us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.733312:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788587164.733347:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587164.733361:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788587164.733369:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309970176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.733399:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309970176:12345-0@lo:400:kworker.0 Request processed in 32us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.733405:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788587164.733463:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309969152:0@lo:400:kworker.0 00010000:00080000:0.0:1788587164.733478:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf35d54e00 x1875469309970176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587164.733488:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309970176:0@lo:400:kworker.0 00000100:00100000:1.0:1788587164.733684:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309969664:12345-0@lo:400:kworker.0 Request processed in 599us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587164.733691:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00080000:0.0:1788587164.733889:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3ab9c700 x1875469309969664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587164.733899:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3ab9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309969664:0@lo:400:kworker.0 00000100:00100000:2.0:1788587164.737419:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309969024:0@lo:400:kworker.0 00000100:00100000:2.0:1788587164.737465:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309969536:0@lo:400:kworker.0 00000100:00100000:2.0:1788587164.737528:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587164.737576:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309970048:0@lo:400:kworker.0 00000100:00100000:2.0:1788587164.737600:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587164.740153:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309969536 00000100:00100000:1.0:1788587164.740171:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309969536 00000100:00080000:1.0:1788587164.740215:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587164.740273:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309970048 00000100:00100000:1.0:1788587164.740277:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309970048 00000100:00080000:1.0:1788587164.740297:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587164.740325:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788587164.740335:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309969536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587164.740416:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309969536:12345-0@lo:400:kworker.0 Request processed in 83us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587164.740424:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788587164.740440:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788587164.740446:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309970048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587164.740474:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309970048:12345-0@lo:400:kworker.0 Request processed in 29us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587164.740498:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788587164.740668:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309969536:0@lo:400:kworker.0 00000100:00100000:2.0:1788587164.740682:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309970048:0@lo:400:kworker.0 00000100:00100000:3.0:1788587164.741075:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587164.741184:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309969408:0@lo:400:kworker.0 00000100:00100000:3.0:1788587164.741223:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587164.741243:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309969920:0@lo:400:kworker.0 00000100:00100000:3.0:1788587164.741290:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587164.741328:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309970432:0@lo:400:kworker.0 00000100:00100000:3.0:1788587164.741349:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587164.741384:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309969920 00000100:00100000:3.0:1788587164.741390:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309969920 00000100:00100000:3.0:1788587164.741420:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309970432 00000100:00100000:3.0:1788587164.741424:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309970432 00000100:00100000:3.0:1788587164.741442:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788587164.741449:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309969920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587164.741495:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309969920:12345-0@lo:400:kworker.0 Request processed in 45us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587164.741502:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788587164.741527:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788587164.741534:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3472:x1875469309970432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587164.741562:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3472:x1875469309970432:12345-0@lo:400:kworker.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587164.741568:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788587164.741603:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309969920:0@lo:400:kworker.0 00000100:00100000:3.0:1788587164.741613:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309970432:0@lo:400:kworker.0 00000100:00100000:1.0:1788587164.741858:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309969408 00000100:00100000:1.0:1788587164.741863:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309969408 00000100:00100000:1.0:1788587164.741899:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788587164.741905:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309969408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587164.741944:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309969408:12345-0@lo:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587164.741950:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788587164.742308:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309969408:0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.745609:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309968896 00000100:00100000:0.0:1788587164.745624:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309968896 00000100:00100000:0.0:1788587164.745699:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788587164.745725:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309968896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587164.745845:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309968896:12345-0@lo:400:kworker.0 Request processed in 122us (4770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587164.745852:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788587164.746653:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309968896:0@lo:400:kworker.0 00010000:00010000:3.0:1788587165.099376:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587165.227082:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587165.227092:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587165.227156:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788587165.227165:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587165.227291:0:13326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309970688:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587165.227376:0:13326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587165.227606:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3a739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309970560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587165.227656:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587165.227702:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309970560 00000100:00100000:0.0:1788587165.227708:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309970560 00000100:00100000:0.0:1788587165.227755:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788587165.227765:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309970560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587165.227788:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587165.227867:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309970560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587165.227875:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788587165.227922:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3a739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309970560:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1788587165.236336:0:9526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362985538952ns, next at 363985536772ns, rc = 0 00000100:00100000:3.0:1788587165.236371:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309970816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587165.236451:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.236700:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.236743:0:13326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f0e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309970688:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587165.236895:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292071808 00000100:00100000:2.0:1788587165.236903:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292071808 00000100:00100000:2.0:1788587165.236959:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:2.0:1788587165.236968:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+60:11532:x1875469292071808:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587165.236997:0:6472:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587165.237094:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+60:11532:x1875469292071808:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 126us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.237115:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00080000:2.0:1788587165.237213:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587165.237264:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309970816 00000100:00100000:2.0:1788587165.237268:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309970816 00000100:00100000:2.0:1788587165.237298:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788587165.237305:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3474:x1875469309970816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587165.237321:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587165.237360:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3474:x1875469309970816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.237366:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788587165.237383:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587165.240236:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309970816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587165.251099:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.251345:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292071936 00000100:00100000:1.0:1788587165.251356:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292071936 00000100:00100000:1.0:1788587165.251410:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:1.0:1788587165.251420:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+60:11532:x1875469292071936:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788587165.251507:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251525:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251537:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251553:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251575:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251583:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251622:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251632:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251640:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587165.251679:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788587165.251684:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587165.251697:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251709:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251716:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251723:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251729:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587165.251734:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251750:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251763:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:1.0:1788587165.251766:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587165.251772:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251778:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421ccc00/0x419e1ae1f63440e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251816:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251823:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251829:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251835:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587165.251838:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251844:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251851:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8cbf07fc8400) 00010000:00010000:1.0:1788587165.251855:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587165.251857:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251875:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63440ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251893:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251899:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251905:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251910:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587165.251914:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251920:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251928:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:1.0:1788587165.251930:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587165.251933:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.251938:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63440f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587165.252036:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+60:11532:x1875469292071936:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 616us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.252044:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:3.0:1788587165.254356:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.254433:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292072192 00000100:00100000:0.0:1788587165.254444:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292072192 00000100:00100000:0.0:1788587165.254513:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:0.0:1788587165.254524:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+60:11532:x1875469292072192:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587165.254543:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587165.254564:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f63440f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5979 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254661:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254698:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254711:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587165.254724:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788587165.254864:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254871:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254877:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254882:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.254886:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254894:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254907:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587165.254911:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587165.254914:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254921:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f63440ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254966:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f63440f8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5979 expref: 62 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.254983:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:0.0:1788587165.254986:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587165.254990:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f63440f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5979 expref: 62 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.255001:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01483200, rc 0) 00000100:00100000:0.0:1788587165.255081:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+61:11532:x1875469292072192:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 558us (740us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788587165.255090:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:3.0:1788587165.260544:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.266552:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292072320 00000100:00100000:2.0:1788587165.266570:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292072320 00000100:00100000:2.0:1788587165.266820:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:2.0:1788587165.266834:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+61:11532:x1875469292072320:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587165.266876:0:8126:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587165.267232:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+61:11532:x1875469292072320:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 399us (6695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.267240:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:0.0:1788587165.275520:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.275599:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292072576 00000100:00100000:1.0:1788587165.275609:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292072576 00000100:00100000:1.0:1788587165.275674:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:1.0:1788587165.275684:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+61:11532:x1875469292072576:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587165.275706:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587165.275710:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788587165.275735:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f634409d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd595d expref: 61 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.275753:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:1.0:1788587165.275758:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587165.275770:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f634410d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5980 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587165.276208:0:6474:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788587165.276416:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f6344114 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.276430:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f6344114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.276441:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f6344114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.276504:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f634410d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5980 expref: 63 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.276520:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f6344114 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5980 expref: 62 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.276540:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf07fc8400) 00010000:00010000:1.0:1788587165.276543:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587165.276545:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f400, rc 0) 00000100:00100000:1.0:1788587165.276608:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+62:11532:x1875469292072576:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 925us (1097us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788587165.276616:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:1.0:1788587165.296763:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587165.297305:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292072832 00000100:00100000:3.0:1788587165.297315:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292072832 00000100:00100000:3.0:1788587165.297367:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:3.0:1788587165.297376:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+62:11532:x1875469292072832:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587165.297432:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587165.297458:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f6344114 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5980 expref: 62 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297488:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf07fc8400) 00010000:00010000:3.0:1788587165.297499:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587165.297522:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297534:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297543:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297606:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297614:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297633:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297693:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297700:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297706:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297711:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587165.297716:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297723:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297731:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:3.0:1788587165.297734:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587165.297737:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297743:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344122 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297753:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297759:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297771:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297776:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587165.297779:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297785:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297831:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1830f778 (ffff8cbf02c76f00) 00010000:00010000:3.0:1788587165.297834:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587165.297837:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.297843:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f6344129 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1830f778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587165.297919:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+61:11532:x1875469292072832:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 543us (1164us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587165.297926:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:2.0:1788587165.302051:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.304169:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292072960 00000100:00100000:0.0:1788587165.304184:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292072960 00000100:00100000:0.0:1788587165.304262:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 127 00000100:00100000:0.0:1788587165.304274:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+61:11532:x1875469292072960:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587165.304296:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587165.304324:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344130 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5987 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.304360:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.304375:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.304390:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.304513:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344130 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 63 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.304533:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 62 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.304543:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587165.304546:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587165.304549:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf01482200, rc 0) 00000100:00100000:0.0:1788587165.304612:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+62:11532:x1875469292072960:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 340us (3108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587165.304619:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 127 00000001:00080000:2.0:1788587165.310353:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788587165.310383:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788587165.312641:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.312717:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292073216 00000100:00100000:2.0:1788587165.312727:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292073216 00000100:00100000:2.0:1788587165.312779:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:2.0:1788587165.312787:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+62:11532:x1875469292073216:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587165.312921:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.312938:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.312951:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587165.313307:0:13560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788587165.313317:0:13560:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363062522584ns, next at 364062520453ns, rc = 0 00000004:00010000:2.0:1788587165.313401:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083adfc15 reply state 00000000d8b9b265 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.313415:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.313423:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587165.313426:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788587165.313429:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587165.313662:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+64:11532:x1875469292073216:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 874us (1029us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788587165.313670:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:0.0:1788587165.326560:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.328279:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292073344 00000100:00100000:2.0:1788587165.328291:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292073344 00000100:00100000:2.0:1788587165.328383:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:2.0:1788587165.328395:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+64:11532:x1875469292073344:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587165.328419:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587165.328441:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd598e expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.328523:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 65 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.328540:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 65 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.328558:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587165.328562:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587165.328565:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062afe00, rc 0) 00000100:00100000:2.0:1788587165.328635:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+65:11532:x1875469292073344:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 242us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.328642:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:2.0:1788587165.335211:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587165.335297:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292073472 00000100:00100000:3.0:1788587165.335307:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292073472 00000100:00100000:3.0:1788587165.335380:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:3.0:1788587165.335391:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2409:x1875469292073472:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788587165.335441:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587165.335679:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:2409:x1875469292073472:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 289us (477us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788587165.335686:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:1.0:1788587165.345377:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.346527:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292073728 00000100:00100000:0.0:1788587165.346540:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292073728 00000100:00100000:2.0:1788587165.346721:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:2.0:1788587165.346734:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+65:11532:x1875469292073728:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587165.347163:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+66:11532:x1875469292073728:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 430us (1793us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788587165.347171:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:2.0:1788587165.351192:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.351414:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292073984 00000100:00100000:0.0:1788587165.351425:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292073984 00000100:00100000:0.0:1788587165.351480:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:0.0:1788587165.351490:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+66:11532:x1875469292073984:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587165.351601:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+66:11532:x1875469292073984:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 112us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587165.351608:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:3.0:1788587165.353695:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.354222:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292074112 00000100:00100000:1.0:1788587165.354232:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292074112 00000100:00100000:1.0:1788587165.354292:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:1.0:1788587165.354301:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf341ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+66:11532:x1875469292074112:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587165.354321:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587165.354342:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634414c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5995 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.354409:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344153 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.354424:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.354436:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587165.354601:0:6472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587165.354640:0:6472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.354667:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634414c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5995 expref: 68 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.354686:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5995 expref: 67 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.354695:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:1.0:1788587165.354698:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587165.354702:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499ec00, rc 0) 00000100:00100000:1.0:1788587165.355303:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf341ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+67:11532:x1875469292074112:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 999us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.355313:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:1.0:1788587165.358311:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587165.358443:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292074240 00000100:00100000:3.0:1788587165.358453:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292074240 00000100:00100000:3.0:1788587165.358519:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:3.0:1788587165.358530:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+9:2410:x1875469292074240:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587165.358546:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587165.358568:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd599c expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587165.358596:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac9d, blocks: 0x1 00010000:00010000:3.0:1788587165.358615:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1788587165.358620:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587165.358629:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 10 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.358649:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 10 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.358662:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105000, rc 0) 00000100:00100000:3.0:1788587165.358728:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+10:2410:x1875469292074240:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 200us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587165.358736:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:0.0:1788587165.361206:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.361297:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292074496 00000100:00100000:2.0:1788587165.361306:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292074496 00000100:00100000:2.0:1788587165.361380:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:2.0:1788587165.361390:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+67:11532:x1875469292074496:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788587165.361547:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+67:11532:x1875469292074496:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 158us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.361554:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:0.0:1788587165.364172:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587165.364242:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292074624 00000100:00100000:3.0:1788587165.364258:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292074624 00000100:00100000:3.0:1788587165.364311:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:3.0:1788587165.364321:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+10:11532:x1875469292074624:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587165.364352:0:8099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587165.364370:0:8099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59a3 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.364398:0:8099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 11 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.364407:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587165.364411:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587165.364417:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 11 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.364448:0:8099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 11 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.364462:0:8099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 11 pid: 8101 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587165.364486:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8099:1875469309970944:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788587165.364571:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587165.367292:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8099:1875469309970944:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788587165.367325:0:8099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 11 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.367344:0:8099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105a00, rc 0) 00000100:00100000:3.0:1788587165.367414:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+11:11532:x1875469292074624:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 3094us (3250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587165.367423:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:2.0:1788587165.369536:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.369619:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292074752 00000100:00100000:0.0:1788587165.369628:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292074752 00010000:00010000:0.0:1788587165.369679:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 11 pid: 8101 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587165.369753:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:0.0:1788587165.369763:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+11:2409:x1875469292074752:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587165.369779:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587165.369835:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 11 pid: 8101 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.369849:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 11 pid: 8101 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.369874:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a3d856f/0x419e1ae1f634415a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd599c expref: 11 pid: 8101 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.369890:0:6459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587165.369894:0:6459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587165.369903:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 10 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.369913:0:6459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 10 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.369952:0:6459:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 10 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587165.369979:0:6459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6459:1875469309971072:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788587165.370060:0:6459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bc1a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587165.373160:0:6459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6459:1875469309971072:192.168.203.14@tcp:105: 00010000:00010000:2.0:1788587165.373188:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587165.374327:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+10:2409:x1875469292074752:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 4558us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.374341:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:3.0:1788587165.375118:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.375260:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292074880 00000100:00100000:2.0:1788587165.375270:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292074880 00002000:00100000:2.0:1788587165.375316:0:8105:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8cbf3bd50a80 x1875469292074880/t0(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:481/0 lens 504/0 e 0 to 0 dl 1788587176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587165.375328:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf3bd50a80 with x1875469292074880 ext(0->12) 00002000:00010000:2.0:1788587165.375333:0:8105:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbf3bd50a80 00000100:00100000:2.0:1788587165.375359:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:2.0:1788587165.375369:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+10:2409:x1875469292074880:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587165.375828:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+12:2409:x1875469292074880:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 Request processed in 458us (712us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788587165.375837:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00002000:00100000:2.0:1788587165.375845:0:8105:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8cbf3bd50a80 x1875469292074880/t4294967309(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:481/0 lens 504/448 e 0 to 0 dl 1788587176 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587165.375854:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf3bd50a80 with x1875469292074880 ext(0->12) 00002000:00010000:2.0:1788587165.375857:0:8105:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbf3bd50a80 00000100:00100000:0.0:1788587165.379015:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.379447:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292075008 00000100:00100000:2.0:1788587165.379457:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292075008 00000100:00100000:2.0:1788587165.379638:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:2.0:1788587165.379649:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+67:11532:x1875469292075008:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788587165.403158:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+67:11532:x1875469292075008:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 23502us (24144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587165.403170:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 133 00000001:00080000:2.0:1788587165.403622:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1788587165.403661:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788587165.403679:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf084f8480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788587165.403684:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf35f7ba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf084f8180 00000020:00080000:2.0:1788587165.403686:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf35f7b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf3cd06800 00000001:00080000:2.0:1788587165.403715:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000001:00080000:2.0:1788587165.403740:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788587165.403747:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788587165.403771:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1788587165.403777:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788587165.403817:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf03263840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788587165.403821:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf04a17b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf032636c0 00000020:00080000:2.0:1788587165.403824:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf04a17700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf370d1c00 00000020:00080000:2.0:1788587165.403945:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788587165.404134:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1788587165.404151:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.404162:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.404170:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.404193:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587165.404198:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.404205:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.404232:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587165.404235:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587165.404240:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.404247:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634413e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587165.404362:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309971200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788587165.404415:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.404462:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309971456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788587165.404494:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.404514:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587165.404519:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309971328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788587165.404540:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.404563:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309971200 00000100:00100000:3.0:1788587165.404564:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309971456 00000100:00100000:3.0:1788587165.404571:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309971456 00000100:00100000:2.0:1788587165.404571:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309971200 00000100:00100000:3.0:1788587165.404605:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309971328 00000100:00100000:3.0:1788587165.404608:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309971328 00010000:00010000:0.0:1788587165.404695:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404705:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404711:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404716:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.404719:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404725:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404736:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cbf2c8beb00) 00010000:00010000:0.0:1788587165.404739:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587165.404742:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404748:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f6343e82 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404778:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404785:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404790:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404815:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.404818:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404824:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404833:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cbf2c8be100) 00010000:00010000:0.0:1788587165.404835:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587165.404838:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404843:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6343f1c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404858:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404864:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404870:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404882:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.404886:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404892:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404900:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:0.0:1788587165.404903:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587165.404906:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404912:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f6343f9a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404923:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404928:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404934:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404940:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.404942:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404948:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404965:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491700) 00010000:00010000:0.0:1788587165.404968:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587165.404971:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404976:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6343fbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404991:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.404998:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.405004:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.405009:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.405012:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.405017:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.405024:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587165.405026:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587165.405029:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.405035:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f6344081 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587165.405113:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587165.405124:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3473:x1875469309971456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788587165.405337:0:8101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788587165.405346:0:8101:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788587165 00002000:00010000:2.0:1788587165.405349:0:8101:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788587165.405351:0:8101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788587165 -> 1788587165 00002000:00010000:2.0:1788587165.405353:0:8101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788587165.405409:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3473:x1875469309971456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 287us (912us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788587165.405418:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587165.405437:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587165.405444:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309971200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788587165.405459:0:8101:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788587165.405483:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9bac9b, atime: 0x6a9bac9b, ctime: 0x6a9bac9b, blocks: 0xb 00010000:00010000:2.0:1788587165.405490:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.405504:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1788587165.405508:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587165.405514:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.405540:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.405550:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.405557:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.405590:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587165.406067:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469309971200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 622us (1650us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788587165.406074:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587165.406089:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788587165.406095:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3473:x1875469309971328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788587165.406109:0:8101:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1788587165.406121:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.406136:0:8101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 11 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.406142:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788587165.406145:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587165.406149:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.406174:0:8101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 11 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.406187:0:8101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 11 pid: 8100 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587165.406198:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8101:1875469309971584:192.168.203.14@tcp:104: 00000100:00080000:1.0:1788587165.407277:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788587165.407408:0:3473:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbf36f28380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788587165.407419:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309971456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788587165.407628:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5cc00 going to sleep for 11 seconds 00010000:00010000:2.0:1788587165.407643:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587165.407650:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.407661:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587165.407665:0:8116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.407675:0:8116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.407692:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.407699:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba794b40/0x419e1ae1f6344168 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.407719:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587165.407721:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587165.407723:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587165.407745:0:3475:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788587165.407751:0:3475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:2.0:1788587165.407770:0:3475:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbf3cdb9180, transno 4294967302 00000004:00080000:2.0:1788587165.407788:0:3475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:2.0:1788587165.407834:0:3475:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbf36f28700 x1875469309971200/t4294967305(4294967305) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587181 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788587165.407860:0:3475:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbf36f28700/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788587165.407864:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309971200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788587165.408715:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587165.408823:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292075136 00000100:00100000:3.0:1788587165.408830:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292075136 00000100:00100000:3.0:1788587165.408872:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:3.0:1788587165.408881:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+12:2410:x1875469292075136:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788587165.412435:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.412776:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292075264 00000100:00100000:1.0:1788587165.412786:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292075264 00010000:00010000:1.0:1788587165.412858:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 13 pid: 8100 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587165.412894:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:1.0:1788587165.412903:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+13:2409:x1875469292075264:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587165.412918:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587165.412923:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 13 pid: 8100 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.412950:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 13 pid: 8100 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.412976:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587165.412980:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587165.412987:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.413118:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.413143:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587165.413202:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+13:2409:x1875469292075264:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 299us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.413209:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 73 00010000:00010000:1.0:1788587165.414962:0:8101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6343f2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5902 expref: 12 pid: 8100 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587165.414985:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fd54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8101:1875469309971584:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587165.415177:0:8101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.415189:0:8101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.415210:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.415361:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.415370:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.415392:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587165.415638:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587165.415645:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.415651:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587165.415654:0:6460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.415660:0:6460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.415673:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.415677:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f634416f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.415698:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587165.415699:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587165.415701:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587165.417528:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3473:x1875469309971328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11425us (12979us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788587165.417541:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1788587165.417726:0:3473:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbf36f29f80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788587165.417733:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309971328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788587165.447868:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+11:2410:x1875469292075136:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 38976us (39146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.447881:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000001:00080000:0.0:1788587165.448302:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1788587165.448316:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788587165.448321:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788587165.453426:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.454683:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292075520 00000100:00100000:1.0:1788587165.454696:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292075520 00000100:00100000:1.0:1788587165.455105:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:1.0:1788587165.455116:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+15:11532:x1875469292075520:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587165.455165:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587165.455192:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344153 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5995 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.455213:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:1.0:1788587165.455218:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587165.455244:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.455292:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.455302:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587165.455584:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad6cd4d4 reply state 00000000043d1ea8 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.455597:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.455604:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:1.0:1788587165.455606:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587165.455609:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587165.456024:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+16:11532:x1875469292075520:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 907us (2653us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788587165.456032:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:1.0:1788587165.458512:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587165.458670:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292075648 00000100:00100000:3.0:1788587165.458679:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292075648 00000100:00100000:3.0:1788587165.458762:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788587165.458773:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292075648:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788587165.459025:0:8099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788587165.459029:0:8099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788587165 -> 1788587164 00002000:00010000:3.0:1788587165.459032:0:8099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788587163 00002000:00010000:3.0:1788587165.459034:0:8099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788587165 -> 1788587164 00002000:00010000:3.0:1788587165.459036:0:8099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788587165.459091:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2411:x1875469292075648:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 319us (587us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788587165.459099:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:2.0:1788587165.464574:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.464639:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292075904 00000100:00100000:0.0:1788587165.464649:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292075904 00000100:00100000:0.0:1788587165.464710:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:0.0:1788587165.464721:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+16:11532:x1875469292075904:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788587165.464820:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.464838:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 16 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.464849:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.464887:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 16 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.464911:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 16 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587165.464948:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309971712:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587165.465026:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bc1a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587165.468757:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.468857:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292076032 00000100:00100000:1.0:1788587165.468868:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292076032 00010000:00010000:1.0:1788587165.468921:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 17 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587165.468962:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 74 00000100:00100000:1.0:1788587165.468973:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+17:2410:x1875469292076032:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587165.468988:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587165.468994:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 17 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.469021:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 17 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.469042:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:1.0:1788587165.469047:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.469057:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.469064:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.469083:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587165.469146:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+17:2410:x1875469292076032:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 174us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.469153:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 74 00010000:00010000:2.0:1788587165.469881:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f6344137 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5987 expref: 16 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587165.469913:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309971712:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587165.469934:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.469944:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.469950:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.469978:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.469985:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.469992:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.469998:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587165.470013:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.470021:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.470033:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587165.470037:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788587165.470041:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.470048:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482a00/0x419e1ae1f634417d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587165.470110:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+15:11532:x1875469292075904:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 Request processed in 5390us (5546us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788587165.470119:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:0.0:1788587165.473104:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.473292:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292076160 00000100:00100000:1.0:1788587165.473302:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292076160 00000100:00100000:1.0:1788587165.473357:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:1.0:1788587165.473367:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2412:x1875469292076160:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788587165.473409:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.473429:0:8101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 7 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.473455:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587165.473460:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587165.473465:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.473500:0:8101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 7 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.473515:0:8101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 7 pid: 8099 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587165.473530:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8101:1875469309971840:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587165.473607:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587165.476741:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.476924:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8101:1875469309971840:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587165.476956:0:8101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587165.477238:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292076288 00000100:00100000:3.0:1788587165.477262:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292076288 00010000:00010000:3.0:1788587165.477308:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 8 pid: 8099 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587165.477382:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 75 00000100:00100000:3.0:1788587165.477397:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2409:x1875469292076288:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587165.477412:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587165.477435:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 8 pid: 8099 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.477535:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 8 pid: 8099 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.477561:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f6344161 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59a3 expref: 8 pid: 8099 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.477576:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587165.477580:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587165.477585:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.477594:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.477662:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587165.477732:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292076288:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 340us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587165.477739:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 75 00010000:00010000:2.0:1788587165.478886:0:8101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.478903:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.478937:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.478962:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.478970:0:8101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.478977:0:8101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587165.478981:0:8101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.478989:0:8101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.479006:0:8101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.479014:0:8101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344184 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587165.479087:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292076160:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 5719us (5990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.479097:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:1.0:1788587165.481386:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.481569:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292076544 00000100:00100000:0.0:1788587165.481578:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292076544 00000100:00100000:0.0:1788587165.481635:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:0.0:1788587165.481646:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+15:11532:x1875469292076544:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788587165.481722:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.481739:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.481750:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.482086:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.482099:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 16 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.482108:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.482285:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 16 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.482311:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 16 pid: 8126 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587165.482325:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309971968:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587165.482439:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bc1a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587165.485763:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.485841:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292076672 00000100:00100000:1.0:1788587165.485849:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292076672 00010000:00010000:1.0:1788587165.485889:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 17 pid: 8126 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587165.485924:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:1.0:1788587165.485933:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+17:2410:x1875469292076672:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587165.485948:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587165.485954:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 17 pid: 8126 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.485985:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 17 pid: 8126 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.486006:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:1.0:1788587165.486011:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.486020:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.486027:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587165.486044:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587165.486160:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344145 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd598e expref: 17 pid: 8126 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587165.486187:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309971968:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587165.486212:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.486221:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.486227:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587165.486425:0:13560:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788587165.486594:0:13560:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788587165.486640:0:13560:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788587165.486721:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13560:1875469309972096:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788587165.486769:0:13560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.486815:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02eab900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587165.488447:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:2410:x1875469292076672:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 2505us (2683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.488460:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:1.0:1788587165.488559:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309972096 00000100:00100000:1.0:1788587165.488567:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309972096 00000100:00100000:1.0:1788587165.488649:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788587165.488658:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13560:x1875469309972096:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788587165.488775:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13560:x1875469309972096:12345-0@lo:1000:mdt00_004.0 Request processed in 117us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.488782:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788587165.488874:0:13560:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788587165.488879:0:13560:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1788587165.488900:0:13560:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbf36f28380, transno 4294967310 00000100:00100000:2.0:1788587165.488923:0:13560:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbf36f29f80 x1875469309971328/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587181 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587165.488936:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13560:1875469309972096:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788587165.489428:0:13560:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788587165.489516:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13560:1875469309972224:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788587165.489571:0:13560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.490411:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ff840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587165.490596:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309972224 00000100:00100000:3.0:1788587165.490605:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309972224 00000100:00100000:3.0:1788587165.490651:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788587165.490659:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13560:x1875469309972224:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788587165.491354:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13560:x1875469309972224:12345-0@lo:1000:mdt00_004.0 Request processed in 691us (1778us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788587165.491366:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788587165.491539:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13560:1875469309972224:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788587165.491576:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491586:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491593:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491599:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.491604:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491612:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491627:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587165.491630:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587165.491635:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491642:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482e00/0x419e1ae1f6344192 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491679:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491685:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491691:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491696:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.491698:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491704:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491712:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587165.491714:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587165.491721:0:13560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5972 expref: 19 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491732:0:13560:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5972 expref: 19 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491741:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5972 expref: 19 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.491774:0:13560:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5972 expref: 19 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587165.491914:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309972352:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788587165.491992:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bc1a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587165.496510:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.496656:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292076800 00000100:00100000:2.0:1788587165.496664:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292076800 00000100:00100000:2.0:1788587165.496715:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:2.0:1788587165.496725:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+20:11531:x1875469292076800:12345-192.168.203.14@tcp:49:lfs.0 00000100:00100000:2.0:1788587165.496874:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+20:11531:x1875469292076800:12345-192.168.203.14@tcp:49:lfs.0 Request processed in 149us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.496881:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:0.0:1788587165.497463:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cdbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309972352:192.168.203.14@tcp:105: 00010000:00010000:0.0:1788587165.497491:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497501:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f63440d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497540:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497554:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497566:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497575:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497581:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497587:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497592:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.497597:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497616:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497627:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587165.497630:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587165.497633:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497639:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483200/0x419e1ae1f6344199 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497650:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497655:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497661:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497666:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01482200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587165.497669:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497674:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497680:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587165.497682:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587165.497685:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.497700:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482200/0x419e1ae1f634418b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587165.497926:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+19:11532:x1875469292076544:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 16281us (16548us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788587165.497937:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 136 00000020:00080000:0.0:1788587165.497941:0:13560:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788587165.498385:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587165.498390:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587165.499266:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788587165.499279:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587165.502986:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.503105:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.503305:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292077312 00000100:00100000:2.0:1788587165.503315:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292077312 00000100:00100000:2.0:1788587165.503370:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:2.0:1788587165.503381:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:11532:x1875469292077312:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788587165.504095:0:6476:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788587165.504199:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788587165.504240:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.504267:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.504279:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.504301:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.504308:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.504315:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.504338:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587165.504425:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+21:11532:x1875469292077312:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 1045us (1318us total) trans 4294967410 rc 0/0 00010000:00010000:0.0:1788587165.504431:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788587165.504437:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00010000:00010000:0.0:1788587165.504439:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788587165.504443:0:6476:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788587165.504451:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afe00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587165.504456:0:6461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.504466:0:6461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.504480:0:6461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:0.0:1788587165.504483:0:6461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788587165.504489:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.504495:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f63441a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587165.504517:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587165.504519:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587165.504528:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587165.504841:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292077056 00000100:00100000:1.0:1788587165.504850:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292077056 00000100:00100000:1.0:1788587165.504897:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 137 00000100:00100000:1.0:1788587165.504906:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:11531:x1875469292077056:12345-192.168.203.14@tcp:58:lfs.0 00000040:00080000:1.0:1788587165.505175:0:6472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788587165.505383:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:11531:x1875469292077056:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 477us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.505400:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 137 00000100:00100000:1.0:1788587165.544757:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.544950:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292077440 00000100:00100000:2.0:1788587165.544960:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292077440 00000100:00100000:2.0:1788587165.545209:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:2.0:1788587165.545220:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+21:11534:x1875469292077440:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587165.545244:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587165.545274:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f63441a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59aa expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545406:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545421:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545432:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545460:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545468:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545475:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545702:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545713:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 22 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545721:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545754:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 22 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.545766:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 22 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587165.545779:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309972480:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587165.546269:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf084f8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587165.548729:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.548824:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292077696 00000100:00100000:0.0:1788587165.548834:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292077696 00000100:00100000:0.0:1788587165.548888:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:0.0:1788587165.548897:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+23:6381:x1875469292077696:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788587165.548978:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309972480:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587165.549006:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587165.549116:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+24:6381:x1875469292077696:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 218us (393us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788587165.549123:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:0.0:1788587165.551071:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587165.551152:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292077824 00000100:00100000:3.0:1788587165.551162:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292077824 00010000:00010000:3.0:1788587165.551215:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 24 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587165.551261:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:3.0:1788587165.551271:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+24:2409:x1875469292077824:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587165.551285:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587165.551291:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 24 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.551303:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 24 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.551324:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01482c00/0x419e1ae1f63440c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd596b expref: 24 pid: 6473 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.551340:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:3.0:1788587165.551346:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.551354:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.551362:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587165.551392:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587165.551645:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+23:2409:x1875469292077824:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 370us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587165.551654:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00010000:00010000:2.0:1788587165.551960:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.551971:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587165.552097:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788587165.552102:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587165.552126:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552139:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552150:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552157:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552164:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552170:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587165.552174:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552181:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552191:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:2.0:1788587165.552201:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587165.552205:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552211:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552224:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552229:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552235:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552240:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aec00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587165.552243:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552258:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552268:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cbf03491400) 00010000:00010000:2.0:1788587165.552271:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587165.552275:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552281:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552386:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f63441a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59aa expref: 23 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552414:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59aa expref: 22 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587165.552421:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587165.552423:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587165.552426:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae000, rc 0) 00000100:00100000:2.0:1788587165.552471:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+22:11534:x1875469292077440:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 7253us (7722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.552479:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:0.0:1788587165.842088:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.842126:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.842166:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587165.842317:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292078080 00000100:00100000:1.0:1788587165.842328:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292078080 00000100:00100000:1.0:1788587165.842401:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292078336 00000100:00100000:1.0:1788587165.842405:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292078336 00000100:00100000:1.0:1788587165.842444:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 271 00000100:00100000:1.0:1788587165.842455:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292078080:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587165.842530:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292078080:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 77us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.842537:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 271 00000100:00100000:1.0:1788587165.842553:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 272 00000100:00100000:1.0:1788587165.842559:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292078336:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587165.842580:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292078336:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.842586:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 272 00000100:00080000:0.0:1788587165.842850:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587165.842854:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587165.842952:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292077952 00000100:00100000:3.0:1788587165.842957:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292077952 00000100:00100000:3.0:1788587165.842994:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 379 00000100:00100000:3.0:1788587165.843000:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292077952:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587165.843035:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf052bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292077952:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 35us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587165.843041:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 379 00000100:00100000:0.0:1788587165.844565:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587165.844598:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587165.844700:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292078464 00000100:00100000:2.0:1788587165.844707:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292078464 00000100:00100000:2.0:1788587165.844769:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 273 00000100:00100000:2.0:1788587165.844777:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292078464:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587165.844847:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292078464:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.844853:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 273 00000100:00080000:0.0:1788587165.844902:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587165.844948:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292078208 00000100:00100000:1.0:1788587165.844952:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292078208 00000100:00100000:1.0:1788587165.844997:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:1.0:1788587165.845003:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292078208:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587165.845040:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292078208:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 37us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.845046:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00080000:0.0:1788587165.845278:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788587166.123129:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587166.250981:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587166.251005:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309972608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587166.251071:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587166.251131:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309972608 00000100:00100000:0.0:1788587166.251138:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309972608 00000100:00100000:0.0:1788587166.251183:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788587166.251192:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469309972608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587166.251214:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788587166.251268:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469309972608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587166.251303:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788587166.251351:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309972608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587166.251732:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309972736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587166.251758:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587166.251811:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587166.251820:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309972864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587166.251844:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587166.251873:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309972736 00000100:00100000:0.0:1788587166.251876:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309972736 00000100:00100000:0.0:1788587166.251921:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788587166.251927:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309972736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587166.251938:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788587166.251967:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309972736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587166.251973:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788587166.251989:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309972864 00000100:00100000:0.0:1788587166.251992:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309972864 00000100:00100000:0.0:1788587166.252013:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587166.252019:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309972864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587166.252048:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587166.252079:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309972864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587166.252084:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1788587166.252097:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587166.252119:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309972736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587166.252160:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309972864:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788587166.373733:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587166.373743:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587166.373786:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788587166.373813:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788587166.512942:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587166.513019:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587166.513077:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788587166.513085:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587166.513187:0:13326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309972992:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587166.513378:0:13326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587166.522418:0:13326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309972992:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587166.524627:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587166.526339:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292078592 00000100:00100000:2.0:1788587166.526353:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292078592 00000100:00100000:2.0:1788587166.526414:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:2.0:1788587166.526425:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+22:11546:x1875469292078592:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587166.526457:0:6473:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587166.526560:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+22:11546:x1875469292078592:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 136us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587166.526573:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:0.0:1788587166.534113:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587166.534264:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292078848 00000100:00100000:2.0:1788587166.534283:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292078848 00000100:00100000:2.0:1788587166.534409:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 140 00000100:00100000:2.0:1788587166.534419:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+22:11546:x1875469292078848:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587166.534441:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587166.534462:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59b1 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587166.534556:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587166.534572:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587166.534585:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587166.534596:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788587166.534716:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59b1 expref: 25 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587166.534731:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59b1 expref: 24 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587166.534739:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587166.534742:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587166.534745:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062aee00, rc 0) 00000100:00100000:2.0:1788587166.534827:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+24:11546:x1875469292078848:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 408us (722us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788587166.534834:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 140 00000100:00100000:2.0:1788587166.544023:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587166.544059:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587166.544102:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292079232 00000100:00100000:2.0:1788587166.544111:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292079232 00000100:00100000:2.0:1788587166.544167:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788587166.544177:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+24:2409:x1875469292079232:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587166.544195:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587166.544221:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63441ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59b1 expref: 24 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587166.544237:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587166.544252:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587166.544427:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+23:2409:x1875469292079232:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 249us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587166.544434:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:3.0:1788587166.545159:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292079104 00000100:00100000:3.0:1788587166.545166:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292079104 00000100:00100000:3.0:1788587166.545210:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 141 00000100:00100000:3.0:1788587166.545218:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+23:11546:x1875469292079104:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788587166.548183:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548205:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548219:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548433:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548450:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548456:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548461:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587166.548465:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548472:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548483:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:3.0:1788587166.548486:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587166.548489:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587166.548495:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63441d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587166.548638:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+24:11546:x1875469292079104:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 3416us (4848us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788587166.548647:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 141 00000040:00080000:2.0:1788587166.548787:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587166.548791:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587166.549742:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788587166.549753:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587166.555973:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587166.556008:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292079488 00000100:00100000:3.0:1788587166.556018:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292079488 00000100:00100000:3.0:1788587166.556064:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:3.0:1788587166.556073:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+24:11546:x1875469292079488:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587166.557425:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+25:11546:x1875469292079488:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 1348us (1471us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788587166.557436:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:3.0:1788587166.763472:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587166.763496:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309973120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587166.763569:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587166.763773:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309973120 00000100:00100000:1.0:1788587166.763782:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309973120 00000100:00100000:1.0:1788587166.763869:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788587166.763879:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309973120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587166.764108:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1788587166.764168:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309973120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 290us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587166.764175:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788587166.764317:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309973120:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587167.147171:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587168.160948:0:13856:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587168.160958:0:13856:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587168.161046:0:13856:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788587168.161052:0:13856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788587168.171932:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587168.329982:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587168.331314:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292079744 00000100:00100000:1.0:1788587168.331327:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292079744 00000100:00100000:1.0:1788587168.331394:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:1.0:1788587168.331406:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+25:11567:x1875469292079744:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587168.331430:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587168.331452:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63441df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59b8 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587168.331545:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63441e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587168.331576:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63441e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587168.331590:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63441e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587168.331605:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788587168.331738:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63441df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59b8 expref: 28 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587168.331756:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63441e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59b8 expref: 27 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587168.331765:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:1.0:1788587168.331768:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788587168.331772:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f400, rc 0) 00000100:00100000:1.0:1788587168.331848:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+27:11567:x1875469292079744:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 446us (1877us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788587168.331856:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00080000:1.0:1788587168.331877:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587168.340725:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587168.340868:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292079872 00000100:00100000:2.0:1788587168.340878:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292079872 00000100:00100000:2.0:1788587168.340932:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 143 00000100:00100000:2.0:1788587168.340941:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+27:11567:x1875469292079872:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:2.0:1788587168.341017:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341035:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341047:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341073:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341080:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341086:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341092:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aec00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587168.341096:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341105:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341117:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587168.341120:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587168.341125:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.341131:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aec00/0x419e1ae1f63441f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587168.341218:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+27:11567:x1875469292079872:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 278us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587168.341226:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 143 00000100:00100000:0.0:1788587168.418197:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587168.418385:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292080000 00000100:00100000:2.0:1788587168.418395:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292080000 00000100:00100000:2.0:1788587168.418475:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:2.0:1788587168.418488:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292080000:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:2.0:1788587168.418505:0:8100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587168.418525:0:8100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f63441fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59bf expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587168.418551:0:8100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bac9c, atime: 0x6a9bac9b, ctime: 0x6a9bac9c, blocks: 0xb 00010000:00010000:2.0:1788587168.418573:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1788587168.418578:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587168.418587:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f63441fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59bf expref: 7 pid: 8100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.418607:0:8100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f63441fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59bf expref: 7 pid: 8100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587168.418620:0:8100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062aec00, rc 0) 00000100:00100000:2.0:1788587168.418689:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2411:x1875469292080000:12345-192.168.203.14@tcp:101:cat.0 Request processed in 204us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587168.418696:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00080000:0.0:1788587168.418899:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587168.423213:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587168.423339:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292080128 00000100:00100000:1.0:1788587168.423349:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292080128 00002000:00100000:1.0:1788587168.423395:0:8106:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8cbe0370df80 x1875469292080128/t0(0) o3->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:484/0 lens 488/0 e 0 to 0 dl 1788587179 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587168.423407:0:8106:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe0370df80 with x1875469292080128 ext(0->4095) 00002000:00010000:1.0:1788587168.423412:0:8106:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe0370df80 00000100:00100000:1.0:1788587168.423447:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587168.423470:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2411:x1875469292080128:12345-192.168.203.14@tcp:3:cat.0 00000100:00100000:1.0:1788587168.423680:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2411:x1875469292080128:12345-192.168.203.14@tcp:3:cat.0 Request processed in 211us (590us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788587168.423688:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00002000:00100000:1.0:1788587168.423695:0:8106:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8cbe0370df80 x1875469292080128/t0(0) o3->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:484/0 lens 488/4536 e 0 to 0 dl 1788587179 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587168.423703:0:8106:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe0370df80 with x1875469292080128 ext(0->4095) 00002000:00010000:1.0:1788587168.423706:0:8106:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe0370df80 00010000:00010000:3.0:1788587169.196900:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587169.843941:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309973376:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844011:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844060:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309973888:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844083:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844105:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309974400:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844127:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844151:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788587169.844157:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0350b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309973248:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844180:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844197:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309973760:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844216:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844246:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309974272:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844267:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844284:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe057c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309974784:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844314:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844349:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309973504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844372:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844389:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309974016:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844409:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844425:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe057c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309974528:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844457:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844476:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788587169.844481:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309973632:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844502:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844513:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309974144:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844530:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844548:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe057ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309974656:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844565:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587169.844597:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309973376 00000100:00100000:1.0:1788587169.844605:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309973376 00000100:00100000:1.0:1788587169.844639:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309973888 00000100:00100000:1.0:1788587169.844642:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309973888 00000100:00100000:1.0:1788587169.844664:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309974400 00000100:00100000:1.0:1788587169.844667:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309974400 00000100:00100000:1.0:1788587169.844680:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788587169.844688:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309973376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844736:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309973376:12345-0@lo:400:kworker.0 Request processed in 48us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.844744:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788587169.844759:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309974016 00000100:00100000:1.0:1788587169.844762:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309974016 00000100:00100000:1.0:1788587169.844775:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309974528 00000100:00100000:1.0:1788587169.844784:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309974528 00000100:00100000:1.0:1788587169.844823:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309973632 00000100:00100000:1.0:1788587169.844825:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309973632 00000100:00100000:1.0:1788587169.844838:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788587169.844843:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309973888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844874:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309973888:12345-0@lo:400:kworker.0 Request processed in 31us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.844880:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788587169.844893:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788587169.844898:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309974400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844924:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309974400:12345-0@lo:400:kworker.0 Request processed in 26us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.844930:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788587169.844941:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788587169.844947:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309974016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.844979:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469309974016:12345-0@lo:400:kworker.0 Request processed in 32us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.844985:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788587169.844995:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788587169.845001:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309974528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845025:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469309974528:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845031:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788587169.845041:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788587169.845047:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309973632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845070:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309973632:12345-0@lo:400:kworker.0 Request processed in 24us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845082:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788587169.845108:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309973248 00000100:00100000:1.0:1788587169.845111:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309973248 00000100:00100000:1.0:1788587169.845137:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788587169.845142:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309973248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845170:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3475:x1875469309973248:12345-0@lo:400:kworker.0 Request processed in 28us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845175:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788587169.845199:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309973760 00000100:00100000:1.0:1788587169.845202:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309973760 00000100:00100000:1.0:1788587169.845218:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309973504 00000100:00100000:1.0:1788587169.845236:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309973504 00000100:00100000:1.0:1788587169.845250:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788587169.845256:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309973760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845285:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309973760:12345-0@lo:400:kworker.0 Request processed in 29us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845291:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788587169.845301:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788587169.845306:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309973504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845331:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309973504:12345-0@lo:400:kworker.0 Request processed in 25us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845336:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788587169.845353:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309974272 00000100:00100000:1.0:1788587169.845357:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309974272 00000100:00100000:1.0:1788587169.845377:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309974784 00000100:00100000:1.0:1788587169.845379:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309974784 00000100:00100000:1.0:1788587169.845388:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309974144 00000100:00100000:1.0:1788587169.845397:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309974144 00000100:00100000:1.0:1788587169.845413:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309974656 00000100:00100000:1.0:1788587169.845415:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309974656 00000100:00100000:1.0:1788587169.845428:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788587169.845433:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469309974272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845465:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469309974272:12345-0@lo:400:kworker.0 Request processed in 32us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845471:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788587169.845482:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788587169.845488:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469309974784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845529:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469309974784:12345-0@lo:400:kworker.0 Request processed in 40us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845535:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788587169.845547:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788587169.845552:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309974144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845577:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309974144:12345-0@lo:400:kworker.0 Request processed in 25us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845582:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788587169.845592:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788587169.845599:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309974656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845622:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309974656:12345-0@lo:400:kworker.0 Request processed in 24us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587169.845627:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788587169.845663:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587169.845668:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587169.845671:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587169.845673:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587169.845708:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0350b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469309973248:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845721:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309973760:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845732:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309974272:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845741:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe057c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309974784:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845750:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309973376:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845758:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309973888:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845768:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309974400:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845827:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309973632:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845837:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309974144:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845847:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe057ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309974656:0@lo:400:kworker.0 00000100:00100000:1.0:1788587169.845856:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309973504:0@lo:400:kworker.0 00010000:00080000:1.0:1788587169.845867:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03508000 x1875469309974016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587169.845876:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469309974016:0@lo:400:kworker.0 00010000:00080000:1.0:1788587169.845886:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe057c9180 x1875469309974528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587169.845894:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe057c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469309974528:0@lo:400:kworker.0 00010000:00010000:2.0:1788587170.220032:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587170.347932:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309974912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587170.348656:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587170.348672:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309975040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587170.350477:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587170.350566:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309975040 00000100:00100000:1.0:1788587170.350575:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309975040 00000100:00100000:1.0:1788587170.350621:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788587170.350631:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309975040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587170.350667:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587170.350715:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309975040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587170.350722:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788587170.350769:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309975040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587170.352059:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587170.356525:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309974912 00000100:00100000:0.0:1788587170.356538:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309974912 00000100:00100000:0.0:1788587170.356595:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788587170.356617:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309974912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587170.356655:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587170.356746:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309974912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (4691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587170.356753:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788587170.356840:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309974912:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1788587170.410740:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788587170.947128:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:2.0:1788587170.947161:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788587170.947178:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf02eabc00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788587170.947183:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf03603700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf02eab900 00000020:00080000:2.0:1788587170.947186:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf03603d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf370d1c00 00000020:00080000:2.0:1788587170.947418:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1788587170.947845:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587170.947858:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587170.947867:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587170.947873:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587170.947878:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587170.947886:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587170.947906:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cbf2c8be400) 00010000:00010000:2.0:1788587170.947909:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587170.947913:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587170.947919:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344176 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788587170.947985:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788587170.948222:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788587170.954421:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788587170.954444:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788587170.954452:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:1.0:1788587170.964913:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587170.964955:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587170.964979:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587170.965002:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587170.965018:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587170.965037:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587170.965057:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587170.965085:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292080640 00000100:00100000:1.0:1788587170.965094:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292080640 00000100:00100000:1.0:1788587170.965143:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292080768 00000100:00100000:1.0:1788587170.965146:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292080768 00000100:00100000:1.0:1788587170.965165:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:1.0:1788587170.965174:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292080640:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587170.965250:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292080640:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587170.965259:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:1.0:1788587170.965275:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:1.0:1788587170.965291:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292080768:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587170.965318:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292080768:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587170.965324:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:1.0:1788587170.965342:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292080384 00000100:00100000:1.0:1788587170.965346:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292080384 00000100:00100000:1.0:1788587170.965371:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292080896 00000100:00100000:1.0:1788587170.965374:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292080896 00000100:00100000:1.0:1788587170.965385:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292080512 00000100:00100000:1.0:1788587170.965387:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292080512 00000100:00100000:1.0:1788587170.965399:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292081024 00000100:00100000:1.0:1788587170.965401:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292081024 00000100:00100000:1.0:1788587170.965415:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 280 00000100:00100000:1.0:1788587170.965421:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+13:2409:x1875469292080384:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587170.965449:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+13:2409:x1875469292080384:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587170.965455:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 280 00000100:00100000:1.0:1788587170.965467:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 281 00000100:00100000:1.0:1788587170.965472:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292080896:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587170.965494:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292080896:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 22us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587170.965499:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 281 00000100:00100000:1.0:1788587170.965510:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 282 00000100:00100000:1.0:1788587170.965516:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292080512:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587170.965537:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292080512:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 21us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587170.965549:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 282 00000100:00100000:1.0:1788587170.965560:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 283 00000100:00100000:1.0:1788587170.965566:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292081024:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587170.965590:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292081024:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587170.965596:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 283 00000100:00080000:1.0:1788587170.965623:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587170.965627:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587170.965629:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587170.965631:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587170.965696:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292080256 00000100:00100000:2.0:1788587170.965701:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292080256 00000100:00100000:2.0:1788587170.965746:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 381 00000100:00100000:2.0:1788587170.965754:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292080256:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587170.965780:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292080256:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587170.965787:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 381 00010000:00010000:2.0:1788587171.245005:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587171.371996:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf18714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309975168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587171.372043:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309975296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587171.372067:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587171.374879:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309975424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587171.381284:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309975168 00000100:00100000:0.0:1788587171.381298:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309975168 00000100:00100000:0.0:1788587171.381359:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788587171.381370:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309975168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587171.381416:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587171.381492:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309975168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (9425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587171.381501:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788587171.381515:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587171.381532:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf18714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309975168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587171.381557:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587171.381588:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309975296 00000100:00100000:1.0:1788587171.381593:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309975296 00000100:00100000:1.0:1788587171.381649:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309975424 00000100:00100000:1.0:1788587171.381653:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309975424 00000100:00100000:1.0:1788587171.381681:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788587171.381690:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309975296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587171.381707:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00002000:00000024:1.0:1788587171.381715:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587171.381721:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309975424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587171.381738:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587171.381889:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309975424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587171.381891:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309975296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587171.381899:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788587171.381906:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788587171.381933:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587171.381957:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309975424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587171.382318:0:3474:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788587171.382324:0:3474:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbf36f29f80, transno 4294967311 00000004:00080000:3.0:1788587171.382638:0:3474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1788587171.382664:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309975296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587171.885788:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309975552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587171.885982:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587171.887753:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309975552 00000100:00100000:0.0:1788587171.887770:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309975552 00000100:00100000:0.0:1788587171.887854:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788587171.887865:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309975552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587171.887906:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587171.892108:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309975552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4236us (6117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587171.892115:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309975552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587171.892126:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00010000:0.0:1788587172.267388:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587172.716265:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587172.716275:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587172.716319:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788587172.716326:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788587172.972104:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788587172.997508:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587172.998222:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292081152 00000100:00100000:1.0:1788587172.998234:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292081152 00000100:00100000:1.0:1788587172.998311:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00080000:2.0:1788587172.998315:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587172.998322:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+13:11220:x1875469292081152:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788587172.998434:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+13:11220:x1875469292081152:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 Request processed in 114us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587172.998442:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:3.0:1788587173.006870:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587173.010890:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292081280 00000100:00100000:1.0:1788587173.010907:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292081280 00000100:00080000:2.0:1788587173.010986:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587173.011009:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00100000:1.0:1788587173.011022:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+5:11220:x1875469292081280:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788587173.011151:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+5:11220:x1875469292081280:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 Request processed in 132us (4289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587173.011159:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00100000:0.0:1788587173.018453:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587173.018538:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292081536 00000100:00100000:3.0:1788587173.018547:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292081536 00000100:00100000:3.0:1788587173.018604:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:3.0:1788587173.018628:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+13:11220:x1875469292081536:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587173.018984:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+14:11220:x1875469292081536:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 358us (539us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788587173.018992:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00010000:00010000:3.0:1788587173.291001:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587173.511973:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587173.512193:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292081664 00000100:00100000:3.0:1788587173.512224:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292081664 00000100:00100000:3.0:1788587173.512309:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:3.0:1788587173.512320:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:12028:x1875469292081664:12345-192.168.203.14@tcp:101:lsof.0 00010000:00010000:3.0:1788587173.512340:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587173.512362:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344202 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59c6 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587173.512440:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587173.512454:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587173.512466:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587173.512499:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587173.512502:0:6472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587173.512540:0:6472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587173.512578:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344202 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 7 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587173.512610:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 6 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587173.512620:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:3.0:1788587173.512624:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587173.512628:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2600, rc 0) 00000100:00100000:3.0:1788587173.512968:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:12028:x1875469292081664:12345-192.168.203.14@tcp:101:lsof.0 Request processed in 648us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587173.512975:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00080000:2.0:1788587173.513305:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587174.315596:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587174.955945:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587174.955971:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309975936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587174.956035:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309976320:0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956048:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587174.956074:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587174.956124:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309975808:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.956146:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309975680:0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956155:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587174.956196:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309976448:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.956202:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587174.956231:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587174.956237:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309976192:0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956257:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309976960:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.956268:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587174.956289:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587174.956293:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309976704:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.956327:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587174.956339:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309976320 00000100:00100000:0.0:1788587174.956347:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309976320 00000100:00100000:1.0:1788587174.956351:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309977216:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.956378:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587174.956399:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788587174.956404:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309976064:0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956412:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309975808 00000100:00100000:0.0:1788587174.956416:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309975808 00000100:00100000:1.0:1788587174.956429:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587174.956433:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309976448 00000100:00100000:0.0:1788587174.956437:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309976448 00000100:00100000:0.0:1788587174.956454:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309976960 00000100:00100000:1.0:1788587174.956455:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309976576:0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956458:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309976960 00000100:00100000:0.0:1788587174.956471:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309976064 00000100:00100000:0.0:1788587174.956474:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309976064 00000100:00100000:0.0:1788587174.956488:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788587174.956496:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309976320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956557:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469309976320:12345-0@lo:400:kworker.0 Request processed in 61us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587174.956564:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788587174.956580:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788587174.956586:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309975808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956622:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309975808:12345-0@lo:400:kworker.0 Request processed in 36us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587174.956627:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788587174.956638:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788587174.956644:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309976448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956673:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309976448:12345-0@lo:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587174.956679:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788587174.956688:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788587174.956693:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309976960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956714:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309976960:12345-0@lo:400:kworker.0 Request processed in 20us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587174.956719:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788587174.956728:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788587174.956732:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309976064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956754:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309976064:12345-0@lo:400:kworker.0 Request processed in 22us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587174.956760:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00080000:0.0:1788587174.956791:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0370fb80 x1875469309976448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587174.956824:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309976448:0@lo:400:kworker.0 00000100:00080000:2.0:1788587174.956827:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587174.956833:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788587174.956839:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0370d500 x1875469309976960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587174.956848:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309976960:0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956861:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309975808:0@lo:400:kworker.0 00000100:00100000:2.0:1788587174.956862:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309975936 00000100:00100000:2.0:1788587174.956868:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309975936 00000100:00100000:2.0:1788587174.956892:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309976192 00000100:00100000:2.0:1788587174.956896:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309976192 00000100:00100000:0.0:1788587174.956907:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788587174.956915:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309975936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.956955:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309975936:12345-0@lo:400:kworker.0 Request processed in 40us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587174.956967:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587174.956994:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309977088:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957023:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587174.957048:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309976064:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957070:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309976704 00000100:00100000:1.0:1788587174.957073:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309976704 00000100:00100000:1.0:1788587174.957099:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309977216 00000100:00100000:1.0:1788587174.957102:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309977216 00000100:00100000:1.0:1788587174.957114:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309976576 00000100:00100000:1.0:1788587174.957116:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309976576 00000100:00100000:1.0:1788587174.957126:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309977088 00000100:00100000:1.0:1788587174.957129:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309977088 00000100:00100000:1.0:1788587174.957141:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587174.957148:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309976704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957184:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309976704:12345-0@lo:400:kworker.0 Request processed in 37us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587174.957203:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587174.957215:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788587174.957222:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309977216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957251:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309977216:12345-0@lo:400:kworker.0 Request processed in 30us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587174.957257:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788587174.957268:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788587174.957274:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309976576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957299:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309976576:12345-0@lo:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587174.957315:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788587174.957329:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788587174.957334:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309977088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957363:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309977088:12345-0@lo:400:kworker.0 Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587174.957369:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788587174.957403:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309976576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957412:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309977088:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957420:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309976704:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.957428:0:3473:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788587174.957433:0:3473:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbf36f28700, transno 4294967305 00000100:00100000:1.0:1788587174.957444:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309977216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587174.957570:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469309976320:0@lo:400:kworker.0 00000100:00100000:3.0:1788587174.957578:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309976832:0@lo:400:kworker.0 00000100:00100000:3.0:1788587174.957601:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587174.957634:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309976832 00000100:00100000:3.0:1788587174.957638:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309976832 00000100:00100000:3.0:1788587174.957661:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788587174.957667:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309976832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587174.957701:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469309976832:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587174.957707:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788587174.957736:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469309976832:0@lo:400:kworker.0 00000100:00080000:3.0:1788587174.957764:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587174.957768:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587174.957776:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587174.957809:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309975680 00000100:00100000:3.0:1788587174.957813:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309975680 00000100:00100000:3.0:1788587174.957838:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788587174.957845:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309975680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587174.957875:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309975680:12345-0@lo:400:kworker.0 Request processed in 30us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587174.957882:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788587174.957930:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309975936:0@lo:400:kworker.0 00000100:00100000:1.0:1788587174.958371:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309975680:0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.960712:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788587174.960759:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788587174.960777:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309976192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587174.960882:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309976192:12345-0@lo:400:kworker.0 Request processed in 114us (4614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587174.960889:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788587174.962235:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309976192:0@lo:400:kworker.0 00010000:00010000:2.0:1788587175.339277:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587175.467092:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309977344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587175.467166:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587175.467629:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309977344 00000100:00100000:1.0:1788587175.467639:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309977344 00000100:00100000:1.0:1788587175.467692:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788587175.467701:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309977344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587175.467731:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587175.467785:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309977344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587175.467815:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788587175.467863:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309977344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587175.470482:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587175.470502:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309977472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587175.470562:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587175.470628:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309977472 00000100:00100000:3.0:1788587175.470635:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309977472 00000100:00100000:3.0:1788587175.470675:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788587175.470683:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309977472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587175.470704:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587175.471258:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309977472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587175.471269:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788587175.471321:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309977472:0@lo:13:osp-pre-1-0.0 00000020:00080000:0.0:1788587176.013892:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788587176.013922:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788587176.014281:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788587176.014292:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788587176.089881:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587176.089918:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587176.090039:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292082048 00000100:00100000:2.0:1788587176.090049:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292082048 00000100:00100000:2.0:1788587176.090126:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 290 00000100:00100000:2.0:1788587176.090136:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292082048:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587176.090219:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292082048:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 84us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587176.090226:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 290 00000100:00080000:2.0:1788587176.090246:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587176.090788:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292081792 00000100:00100000:1.0:1788587176.090807:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292081792 00000100:00100000:1.0:1788587176.090851:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 383 00000100:00100000:1.0:1788587176.090859:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292081792:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587176.090897:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292081792:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 38us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587176.090903:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 383 00000100:00100000:3.0:1788587176.091031:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587176.091253:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292082304 00000100:00100000:1.0:1788587176.091258:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292082304 00000100:00100000:1.0:1788587176.091293:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:1.0:1788587176.091300:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292082304:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587176.091332:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292082304:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 33us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587176.091339:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:3.0:1788587176.091521:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587176.091734:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292082560 00000100:00100000:1.0:1788587176.091739:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292082560 00000100:00100000:1.0:1788587176.091766:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 291 00000100:00100000:1.0:1788587176.091773:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292082560:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587176.091823:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292082560:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 51us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587176.091831:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 291 00000100:00100000:3.0:1788587176.092016:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00080000:2.0:1788587176.092101:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587176.092106:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587176.092209:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587176.092243:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587176.092282:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292082176 00000100:00100000:2.0:1788587176.092286:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292082176 00000100:00100000:2.0:1788587176.092319:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00100000:2.0:1788587176.092326:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292082176:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587176.092359:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292082176:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587176.092366:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00080000:2.0:1788587176.092380:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587176.093206:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292081920 00000100:00100000:1.0:1788587176.093212:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292081920 00000100:00100000:2.0:1788587176.093278:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292082432 00000100:00100000:2.0:1788587176.093282:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292082432 00000100:00100000:2.0:1788587176.093338:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 292 00000100:00100000:2.0:1788587176.093346:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2412:x1875469292082432:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587176.093390:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2412:x1875469292082432:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 45us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587176.093504:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 292 00000100:00080000:3.0:1788587176.093837:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587176.093957:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 293 00000100:00100000:1.0:1788587176.093966:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+13:2412:x1875469292081920:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587176.094023:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+13:2412:x1875469292081920:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 58us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587176.094030:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 293 00000100:00080000:3.0:1788587176.094255:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587176.365890:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788587176.455493:0:14061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:46:15 (1788587175) 00000100:00100000:2.0:1788587176.491209:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309977600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587176.491292:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587176.491396:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309977600 00000100:00100000:3.0:1788587176.491405:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309977600 00000100:00100000:3.0:1788587176.491465:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788587176.491475:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309977600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587176.491512:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587176.491560:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309977600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587176.491568:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788587176.491614:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309977600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788587176.491712:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587176.492350:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587176.492363:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309977728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587176.492431:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587176.492501:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309977728 00000100:00100000:3.0:1788587176.492506:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309977728 00000100:00100000:3.0:1788587176.492545:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587176.492553:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe064a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309977728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587176.492583:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587176.492625:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe064a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309977728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587176.492633:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587176.492666:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309977728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587176.499560:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587176.499580:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309977856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587176.499648:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587176.499728:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309977856 00000100:00100000:3.0:1788587176.499736:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309977856 00000100:00100000:3.0:1788587176.499787:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788587176.499817:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309977856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587176.499848:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587176.499891:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309977856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587176.499899:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788587176.500261:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587176.500297:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309977856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587177.004682:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309977984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587177.004760:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587177.007467:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309977984 00000100:00100000:3.0:1788587177.007483:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309977984 00000100:00100000:3.0:1788587177.007610:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788587177.007621:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bacca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309977984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587177.007667:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587177.007932:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bacca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309977984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 311us (3170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587177.007940:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788587177.008029:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309977984:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788587177.387002:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587177.633601:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587177.634069:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292082816 00000100:00100000:1.0:1788587177.634079:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292082816 00000100:00100000:1.0:1788587177.634139:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 147 00000100:00100000:1.0:1788587177.634149:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+13:12294:x1875469292082816:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587177.634179:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587177.634199:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344210 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59cd expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.634521:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.635005:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.635020:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.635038:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.635045:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.635052:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636557:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344225 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636580:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344225 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636591:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344225 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587177.636662:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788587177.636776:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636784:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636791:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636812:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587177.636816:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636824:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636835:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf03491300) 00010000:00010000:1.0:1788587177.636838:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587177.636842:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636848:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344217 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636861:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636871:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636877:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636882:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587177.636885:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636891:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636898:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cbf07fc8b00) 00010000:00010000:1.0:1788587177.636900:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587177.636902:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.636907:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634421e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.637356:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344210 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59cd expref: 16 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.637372:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344225 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59cd expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587177.637379:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:1.0:1788587177.637382:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587177.637389:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fc00, rc 0) 00000100:00100000:1.0:1788587177.637519:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+15:12294:x1875469292082816:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 3371us (3928us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788587177.637529:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 147 00000100:00100000:0.0:1788587177.643907:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587177.644041:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587177.644122:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292083072 00000100:00100000:2.0:1788587177.644132:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292083072 00000100:00100000:2.0:1788587177.644208:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788587177.644218:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+15:2410:x1875469292083072:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587177.644235:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587177.644258:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344225 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59cd expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587177.644278:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:2.0:1788587177.644284:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587177.644346:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+14:2410:x1875469292083072:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 128us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587177.644353:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:1.0:1788587177.645359:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292082944 00000100:00100000:1.0:1788587177.645368:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292082944 00000100:00100000:1.0:1788587177.645705:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 148 00000100:00100000:1.0:1788587177.645716:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+14:12294:x1875469292082944:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788587177.645884:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+14:12294:x1875469292082944:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 170us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587177.645892:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 148 00000100:00100000:0.0:1788587177.648262:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587177.648352:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292083200 00000100:00100000:3.0:1788587177.648362:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292083200 00000100:00100000:3.0:1788587177.648443:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 149 00000100:00100000:3.0:1788587177.648454:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:12294:x1875469292083200:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788587177.648556:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:12294:x1875469292083200:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 104us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587177.648564:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 149 00000040:00080000:1.0:1788587177.835142:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587177.835165:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587177.835929:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788587177.835944:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788587178.092450:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788587178.411058:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587179.287600:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.287748:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292083328 00000100:00100000:3.0:1788587179.287758:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292083328 00000100:00100000:3.0:1788587179.287842:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:3.0:1788587179.287853:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+14:12337:x1875469292083328:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587179.287873:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587179.287919:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f6344233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59d4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.287980:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.287994:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.288006:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.288020:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.288027:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.288034:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587179.288131:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587179.289269:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289280:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289287:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289292:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587179.289296:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289312:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289326:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:3.0:1788587179.289329:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587179.289333:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289339:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f634423a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289350:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289356:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289362:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289367:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587179.289370:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289783:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289868:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cbf02c76300) 00010000:00010000:3.0:1788587179.289872:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587179.289875:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289890:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289930:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f6344233 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59d4 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289939:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:3.0:1788587179.289941:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587179.289945:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f6344233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59d4 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.289953:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3a00, rc 0) 00000100:00100000:3.0:1788587179.290122:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+14:12337:x1875469292083328:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 2269us (2528us total) trans 0 rc 301/301 00000100:00100000:3.0:1788587179.290131:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:0.0:1788587179.303651:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587179.303741:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292083584 00000100:00100000:1.0:1788587179.303751:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292083584 00000100:00100000:1.0:1788587179.303838:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 151 00000100:00100000:1.0:1788587179.303848:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+14:12337:x1875469292083584:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:1.0:1788587179.303902:0:13560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587179.303927:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6343bb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd580d expref: 14 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.303944:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:1.0:1788587179.303949:0:13560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587179.304285:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.304306:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 5 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.304314:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.304345:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 5 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.304358:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 5 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587179.304441:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0350aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309978112:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587179.304563:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf063270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587179.308313:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.308584:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292083712 00000100:00100000:3.0:1788587179.308593:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292083712 00010000:00010000:3.0:1788587179.308648:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 6 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587179.308682:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:3.0:1788587179.308691:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2410:x1875469292083712:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587179.308704:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587179.308711:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 6 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.308755:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 6 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.308777:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:3.0:1788587179.308783:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.308811:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.308819:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.308838:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587179.308882:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2410:x1875469292083712:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 191us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587179.308890:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00080000:0.0:1788587179.309050:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587179.311400:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2600/0x419e1ae1f6344209 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59c6 expref: 5 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587179.311422:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0350aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875469309978112:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587179.311445:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.311454:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.311460:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.311482:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.311501:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.311511:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313310:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313328:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313339:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587179.313353:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043ce8b23 reply state 000000009e391051 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313364:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313434:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587179.313438:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587179.313442:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788587179.313448:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788587179.313456:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313463:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313469:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313483:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ec00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587179.313487:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313495:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313505:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76c00) 00010000:00010000:1.0:1788587179.313508:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587179.313511:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313517:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344248 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587179.313535:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043ce8b23 reply state 000000009e391051 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313543:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.313549:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cbf07fc8f00) 00010000:00010000:1.0:1788587179.313551:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587179.313553:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788587179.313744:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+15:12337:x1875469292083584:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 9893us (10099us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788587179.313753:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 151 00010000:00010000:2.0:1788587179.435403:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587179.436025:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.436113:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292083840 00000100:00100000:3.0:1788587179.436122:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292083840 00000100:00100000:3.0:1788587179.436199:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 152 00000100:00100000:3.0:1788587179.436210:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+15:12345:x1875469292083840:12345-192.168.203.14@tcp:101:lctl.0 00010000:00010000:3.0:1788587179.436233:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587179.436255:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f634425d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59db expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.436316:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344264 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.436346:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.436357:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587179.436391:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587179.436395:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587179.436414:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.436439:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f634425d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59db expref: 17 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.436473:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59db expref: 16 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.436483:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587179.436486:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587179.436490:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3200, rc 0) 00000100:00100000:3.0:1788587179.436998:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+16:12345:x1875469292083840:12345-192.168.203.14@tcp:101:lctl.0 Request processed in 789us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587179.437006:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 152 00000100:00100000:1.0:1788587179.489037:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.489232:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292083968 00000100:00100000:3.0:1788587179.489242:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292083968 00000100:00100000:3.0:1788587179.489311:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 153 00000100:00100000:3.0:1788587179.489321:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+16:12351:x1875469292083968:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788587179.489340:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587179.489371:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f634426b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59e2 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.489450:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.489464:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.489476:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.489487:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.489494:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.489500:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.491954:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344280 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.491971:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.491983:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587179.492013:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788587179.492016:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587179.492036:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492062:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492068:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492075:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492081:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587179.492085:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492092:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492105:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587179.492108:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587179.492113:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492119:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f6344272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492131:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492137:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492143:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492154:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587179.492167:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492174:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492183:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cbf07fc8f00) 00010000:00010000:3.0:1788587179.492185:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587179.492188:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492194:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344279 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492227:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f634426b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e2 expref: 18 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492242:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e2 expref: 17 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.492249:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:3.0:1788587179.492251:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788587179.492255:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2e00, rc 0) 00000100:00100000:3.0:1788587179.493525:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+17:12351:x1875469292083968:12345-192.168.203.14@tcp:101:bash.0 Request processed in 4200us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587179.493536:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 153 00000100:00100000:0.0:1788587179.499227:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587179.499348:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292084224 00000100:00100000:1.0:1788587179.499358:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292084224 00000100:00100000:1.0:1788587179.499476:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 154 00000100:00100000:1.0:1788587179.499487:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+17:12351:x1875469292084224:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788587179.499509:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587179.499529:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344287 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59e9 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.499658:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.499669:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.499677:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.499735:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.499740:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.499745:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587179.500221:0:13560:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788587179.500360:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500367:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500372:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500402:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500407:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500412:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500417:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587179.500421:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500428:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500439:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587179.500443:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587179.500447:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500453:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f634428e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587179.500464:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004547af9d reply state 0000000036d1c1ed transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500473:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.500479:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8300) 00010000:00010000:1.0:1788587179.500486:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587179.501290:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788587179.501335:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344287 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 20 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.501353:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 19 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.501361:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8a00) 00010000:00010000:1.0:1788587179.501364:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587179.501366:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e600, rc 0) 00000100:00100000:1.0:1788587179.501439:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+20:12351:x1875469292084224:12345-192.168.203.14@tcp:101:bash.0 Request processed in 1954us (2240us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788587179.501447:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 154 00000100:00100000:0.0:1788587179.507888:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.508234:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292084352 00000100:00100000:3.0:1788587179.508250:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292084352 00000100:00100000:3.0:1788587179.508310:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:3.0:1788587179.508319:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292084352:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788587179.508336:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587179.508354:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59f0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587179.508388:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587179.508415:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1788587179.508419:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587179.508428:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 6 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.508447:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 6 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.508460:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3a00, rc 0) 00000100:00080000:2.0:1788587179.508724:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587179.511239:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292084352:12345-192.168.203.14@tcp:101:bash.0 Request processed in 2910us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587179.511250:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:3.0:1788587179.516019:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587179.516213:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292084480 00000100:00100000:2.0:1788587179.516225:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292084480 00000100:00100000:2.0:1788587179.516289:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:2.0:1788587179.516300:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+6:12351:x1875469292084480:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587179.516427:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587179.516447:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59f7 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587179.516488:0:8101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587179.516497:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587179.516501:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587179.516506:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 7 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587179.516541:0:8101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587179.516555:0:8101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 7 pid: 8449 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587179.516568:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf12e81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8101:1875469309978240:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587179.517493:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf084f8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587179.524541:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587179.524567:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf12e81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8101:1875469309978240:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587179.524602:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 7 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587179.524623:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae400, rc 0) 00000100:00100000:2.0:1788587179.524689:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:12351:x1875469292084480:12345-192.168.203.14@tcp:101:bash.0 Request processed in 8390us (8679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587179.524698:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:0.0:1788587179.524786:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292084608 00000100:00100000:0.0:1788587179.524829:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292084608 00010000:00010000:0.0:1788587179.524899:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 7 pid: 8449 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587179.524927:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:0.0:1788587179.524950:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292084608:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587179.524964:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587179.525216:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 7 pid: 8449 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.525230:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 7 pid: 8449 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.525252:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001417e886/0x419e1ae1f63442aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f0 expref: 7 pid: 8449 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.525266:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587179.525270:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587179.525277:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 6 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.525287:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 6 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.525321:0:6457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 6 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587179.525333:0:6457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f21180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6457:1875469309978368:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788587179.525442:0:6457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587179.529596:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587179.529772:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292084864 00000100:00100000:1.0:1788587179.529781:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292084864 00000100:00100000:1.0:1788587179.529869:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:1.0:1788587179.529881:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+20:12351:x1875469292084864:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:1.0:1788587179.530215:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+21:12351:x1875469292084864:12345-192.168.203.14@tcp:35:bash.0 Request processed in 335us (626us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788587179.530223:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:0.0:1788587179.530673:0:6457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f21180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6457:1875469309978368:192.168.203.14@tcp:105: 00010000:00010000:0.0:1788587179.530711:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587179.530736:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292084608:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 5787us (6206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587179.530745:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:2.0:1788587179.634983:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.635070:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292085120 00000100:00100000:3.0:1788587179.635079:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292085120 00000100:00100000:3.0:1788587179.635144:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00100000:3.0:1788587179.635165:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf12e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+21:12361:x1875469292085120:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587179.635202:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587179.635223:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63442b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd59fe expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587179.635321:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788587179.635458:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63442b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59fe expref: 23 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.635473:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587179.635476:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587179.635481:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63442b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59fe expref: 23 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.635495:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3600, rc 0) 00000100:00100000:3.0:1788587179.635555:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf12e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+22:12361:x1875469292085120:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 402us (582us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788587179.635562:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00100000:2.0:1788587179.640878:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587179.640975:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292085376 00000100:00100000:1.0:1788587179.640986:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292085376 00000100:00100000:1.0:1788587179.641041:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:1.0:1788587179.641052:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+22:12361:x1875469292085376:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788587179.641281:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+23:12361:x1875469292085376:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 231us (412us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788587179.641303:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:1.0:1788587179.688896:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.689029:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292085504 00000100:00100000:3.0:1788587179.689038:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292085504 00000100:00100000:3.0:1788587179.689092:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 156 00000100:00100000:3.0:1788587179.689102:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+23:12367:x1875469292085504:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587179.689129:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587179.689149:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63442c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a05 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.689215:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f63442cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.689244:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f63442cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.689255:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f63442cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587179.689296:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788587179.689299:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587179.689315:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f63442cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.689351:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63442c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a05 expref: 25 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.689376:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f63442cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a05 expref: 24 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.689383:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:3.0:1788587179.689386:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587179.689389:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3e00, rc 0) 00000100:00100000:3.0:1788587179.689447:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+24:12367:x1875469292085504:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 339us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587179.689454:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 156 00000100:00100000:2.0:1788587179.694263:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587179.697716:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292085760 00000100:00100000:1.0:1788587179.697731:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292085760 00000100:00100000:1.0:1788587179.697862:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 157 00000100:00100000:1.0:1788587179.697875:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+24:12367:x1875469292085760:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587179.697894:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587179.697914:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f63442d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a0c expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.698009:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63442db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.698022:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63442db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.698033:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63442db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587179.698053:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788587179.698543:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f63442d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a0c expref: 27 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.698564:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63442db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a0c expref: 26 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.698573:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8a00) 00010000:00010000:1.0:1788587179.698576:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587179.698592:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e200, rc 0) 00000100:00100000:1.0:1788587179.698659:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+26:12367:x1875469292085760:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 787us (4406us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788587179.698667:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 157 00000100:00100000:2.0:1788587179.708248:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587179.708292:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587179.708509:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292086144 00000100:00100000:0.0:1788587179.708520:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292086144 00000100:00100000:0.0:1788587179.708592:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:0.0:1788587179.708603:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+26:2409:x1875469292086144:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587179.708617:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587179.708640:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63442db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a0c expref: 26 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.708657:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8a00) 00010000:00010000:0.0:1788587179.708662:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587179.708718:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+25:2409:x1875469292086144:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 116us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587179.708725:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:3.0:1788587179.711440:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292086016 00000100:00100000:3.0:1788587179.711453:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292086016 00000100:00100000:3.0:1788587179.711541:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 158 00000100:00100000:3.0:1788587179.711552:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+25:12367:x1875469292086016:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587179.711573:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587179.711604:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63442e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a13 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.711710:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63442f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.711725:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63442f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.711736:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63442f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587179.711747:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788587179.711893:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f63442e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a13 expref: 28 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.711910:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63442f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a13 expref: 27 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.711918:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8a00) 00010000:00010000:3.0:1788587179.711921:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788587179.711925:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2800, rc 0) 00000100:00100000:3.0:1788587179.711981:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+27:12367:x1875469292086016:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 432us (3743us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788587179.711988:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 158 00000100:00100000:2.0:1788587179.717725:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587179.719483:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292086272 00000100:00100000:0.0:1788587179.719497:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292086272 00000100:00100000:0.0:1788587179.719562:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:0.0:1788587179.719573:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292086272:12345-192.168.203.14@tcp:1:lfs.0 00010000:00010000:0.0:1788587179.719618:0:8099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.719639:0:8099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 6 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.719667:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587179.719671:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587179.719676:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.719715:0:8099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 6 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.719729:0:8099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 6 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587179.719744:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8099:1875469309978496:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587179.719859:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587179.723008:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587179.723101:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292086400 00000100:00100000:2.0:1788587179.723111:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292086400 00002000:00100000:2.0:1788587179.723172:0:8105:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8cbe0350b100 x1875469292086400/t0(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:495/0 lens 504/0 e 0 to 0 dl 1788587190 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587179.723184:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe0350b100 with x1875469292086400 ext(0->12) 00010000:00010000:2.0:1788587179.723194:0:8105:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 7 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587179.723211:0:8105:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 7 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587179.723219:0:8105:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe0350b100 00000100:00100000:2.0:1788587179.723249:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:2.0:1788587179.723269:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292086400:12345-192.168.203.14@tcp:4:lfs.0 00000100:00100000:2.0:1788587179.723736:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:2409:x1875469292086400:12345-192.168.203.14@tcp:4:lfs.0 Request processed in 465us (735us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788587179.723744:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00002000:00100000:2.0:1788587179.723752:0:8105:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8cbe0350b100 x1875469292086400/t4294967306(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:495/0 lens 504/448 e 0 to 0 dl 1788587190 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587179.723760:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe0350b100 with x1875469292086400 ext(0->12) 00010000:00010000:2.0:1788587179.723766:0:8105:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 9 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587179.723778:0:8105:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 9 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587179.723786:0:8105:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe0350b100 00000100:00100000:0.0:1788587179.724063:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8099:1875469309978496:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587179.724084:0:8099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587179.728748:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587179.728843:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292086528 00000100:00100000:0.0:1788587179.728855:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292086528 00010000:00010000:0.0:1788587179.728899:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 9 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587179.728942:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:0.0:1788587179.728953:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:2411:x1875469292086528:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587179.728974:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788587179.728992:0:6457:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788587179.728995:0:6457:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788587179 00002000:00010000:0.0:1788587179.728998:0:6457:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788587179 00002000:00010000:0.0:1788587179.729000:0:6457:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788587179 00010000:00010000:0.0:1788587179.729006:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 9 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.729020:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 9 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.729042:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001af0377b/0x419e1ae1f63442b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59f7 expref: 9 pid: 8101 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.729058:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587179.729063:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587179.729068:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.729078:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.729112:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587179.729173:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2411:x1875469292086528:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 221us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587179.729180:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 80 00010000:00010000:1.0:1788587179.729248:0:8099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.729258:0:8099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.729282:0:8099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.729291:0:8099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.729300:0:8099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.729306:0:8099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587179.729311:0:8099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.729320:0:8099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.729347:0:8099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.729354:0:8099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000017383a9/0x419e1ae1f63442fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587179.729399:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292086272:12345-192.168.203.14@tcp:1:lfs.0 Request processed in 9828us (11684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587179.729407:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:3.0:1788587179.735631:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587179.735705:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292086784 00000100:00100000:1.0:1788587179.735714:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292086784 00000100:00100000:1.0:1788587179.735764:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788587179.735773:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+27:12367:x1875469292086784:12345-192.168.203.14@tcp:35:lfs.0 00000004:00010000:1.0:1788587179.735866:0:6476:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63442f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a13 expref: 27 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587179.736077:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788587179.736115:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788587179.736556:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788587179.736606:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.736620:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 31 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.736629:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.736666:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 31 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.736680:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 31 pid: 13560 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587179.736694:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6476:1875469309978624:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587179.736777:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06327f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587179.740122:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.740215:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292086912 00000100:00100000:3.0:1788587179.740224:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292086912 00010000:00010000:3.0:1788587179.740264:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 32 pid: 13560 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587179.740321:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:3.0:1788587179.740332:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+32:2410:x1875469292086912:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587179.740346:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587179.740358:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 32 pid: 13560 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.740379:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 32 pid: 13560 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.740401:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8a00) 00010000:00010000:3.0:1788587179.740405:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.740413:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.740420:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.740437:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587179.740486:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+32:2410:x1875469292086912:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 155us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587179.740493:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 81 00010000:00010000:1.0:1788587179.740908:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634429c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e9 expref: 31 pid: 13560 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587179.740925:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6476:1875469309978624:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587179.740947:0:6476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.740956:0:6476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.740961:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587179.741075:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788587179.741266:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788587179.742196:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309978752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788587179.742284:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587179.742318:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06327180 going to sleep for 11 seconds 00000100:00100000:2.0:1788587179.742391:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309978752 00000100:00100000:2.0:1788587179.742398:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309978752 00000100:00100000:2.0:1788587179.742459:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788587179.742468:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6476:x1875469309978752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788587179.742538:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6476:x1875469309978752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587179.742545:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788587179.742669:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309978752:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788587179.743066:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788587179.743489:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788587179.743555:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309978880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788587179.743593:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587179.743619:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a9780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587179.743694:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309978880 00000100:00100000:2.0:1788587179.743699:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309978880 00000100:00100000:2.0:1788587179.743735:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788587179.743743:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6476:x1875469309978880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788587179.743977:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6476:x1875469309978880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 234us (382us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788587179.743984:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788587179.744082:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6476:1875469309978880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788587179.744128:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788587179.744190:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.744200:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.744207:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.744213:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587179.744218:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.744226:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.744240:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8a00) 00010000:00010000:3.0:1788587179.744243:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788587179.744248:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.744254:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344305 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587179.744553:0:6476:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788587179.744664:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788587179.744674:0:6476:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377493879216ns, next at 378493877385ns, rc = 0 00000001:00080000:3.0:1788587179.744680:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788587179.744715:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8a00) 00010000:00010000:3.0:1788587179.744718:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788587179.744725:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63442f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a13 expref: 35 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587179.744968:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+34:12367:x1875469292086784:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 9196us (9345us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788587179.744977:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00000020:00080000:3.0:1788587179.744981:0:6476:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788587179.747716:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587179.748204:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292087040 00000100:00100000:1.0:1788587179.748214:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292087040 00000100:00100000:1.0:1788587179.748300:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 159 00000100:00100000:1.0:1788587179.748310:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+34:12367:x1875469292087040:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587179.748333:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587179.748354:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634430c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a1a expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.748712:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634430c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a1a expref: 35 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.748729:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634430c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a1a expref: 35 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.748747:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587179.748751:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587179.748754:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e600, rc 0) 00000100:00100000:1.0:1788587179.748880:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+35:12367:x1875469292087040:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 571us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587179.748887:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 159 00000100:00100000:2.0:1788587179.751392:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.751520:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292087296 00000100:00100000:3.0:1788587179.751529:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292087296 00000100:00100000:3.0:1788587179.751583:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788587179.751592:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+35:12367:x1875469292087296:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587179.751843:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+36:12367:x1875469292087296:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 251us (468us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788587179.751850:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788587179.832558:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.832649:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292087552 00000100:00100000:3.0:1788587179.832659:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292087552 00000100:00100000:3.0:1788587179.832724:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 160 00000100:00100000:3.0:1788587179.832735:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+36:12377:x1875469292087552:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587179.832758:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587179.832777:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6344313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a21 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587179.832899:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788587179.833019:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6344313 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a21 expref: 38 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.833034:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587179.833037:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587179.833063:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6344313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a21 expref: 38 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.833077:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2800, rc 0) 00000100:00100000:3.0:1788587179.833129:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+37:12377:x1875469292087552:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 396us (579us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788587179.833136:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 160 00000100:00100000:2.0:1788587179.836385:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.836451:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292087680 00000100:00100000:3.0:1788587179.836460:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292087680 00000100:00100000:3.0:1788587179.836513:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 161 00000100:00100000:3.0:1788587179.836523:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+37:12377:x1875469292087680:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:3.0:1788587179.836591:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836607:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836618:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836627:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836634:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836641:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836712:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836742:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836749:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587179.836783:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836822:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836829:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836836:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836841:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587179.836845:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836853:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836863:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:3.0:1788587179.836866:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587179.836870:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836876:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f6344321 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836894:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836900:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836905:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836910:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587179.836913:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836918:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836924:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8300) 00010000:00010000:3.0:1788587179.836926:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587179.836929:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836934:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344328 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836941:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836947:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836952:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836960:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587179.836963:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836969:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836975:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587179.836977:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587179.836980:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587179.836985:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f634432f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587179.837052:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+37:12377:x1875469292087680:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 531us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587179.837059:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 161 00000100:00100000:2.0:1788587179.840551:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.840624:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292087936 00000100:00100000:3.0:1788587179.840634:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292087936 00000100:00100000:3.0:1788587179.840689:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:3.0:1788587179.840699:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+37:12377:x1875469292087936:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587179.840966:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+38:12377:x1875469292087936:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 268us (424us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788587179.840974:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:2.0:1788587179.882204:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587179.882307:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292088192 00000100:00100000:1.0:1788587179.882318:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292088192 00000100:00100000:1.0:1788587179.882382:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 162 00000100:00100000:1.0:1788587179.882413:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+38:12380:x1875469292088192:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587179.882436:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587179.882456:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f6344336 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a28 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882527:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882541:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882553:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882564:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882571:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882578:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882688:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882696:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882703:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587179.882732:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788587179.882868:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882876:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882883:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882888:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587179.882892:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882899:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882911:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587179.882914:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587179.882918:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882924:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634433d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882936:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882942:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882958:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882963:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587179.882966:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882973:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882981:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8300) 00010000:00010000:1.0:1788587179.882983:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587179.882986:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.882992:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344344 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.883026:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f6344336 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 41 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.883039:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 40 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587179.883046:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587179.883048:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587179.883050:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e000, rc 0) 00000100:00100000:1.0:1788587179.883486:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+40:12380:x1875469292088192:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1074us (1290us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788587179.883503:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 162 00000100:00100000:2.0:1788587179.888491:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587179.888579:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292088320 00000100:00100000:0.0:1788587179.888590:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292088320 00000100:00100000:0.0:1788587179.888678:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 163 00000100:00100000:0.0:1788587179.888688:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+40:12380:x1875469292088320:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:0.0:1788587179.888903:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.888920:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.888932:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.888957:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.888963:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.888970:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.888977:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587179.888981:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.888988:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.888998:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:0.0:1788587179.889001:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587179.889005:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587179.889237:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344359 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587179.889315:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+40:12380:x1875469292088320:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 627us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587179.889322:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 163 00000100:00100000:2.0:1788587179.891256:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587179.891346:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292088576 00000100:00100000:3.0:1788587179.891353:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292088576 00000100:00100000:3.0:1788587179.891392:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:0.0:1788587179.891411:0:6476:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1788587179.891416:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+40:12380:x1875469292088576:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788587179.891420:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1788587179.891608:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+41:12380:x1875469292088576:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 195us (357us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788587179.891614:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:3.0:1788587180.076149:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309979008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.076250:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587180.076302:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309979520:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.076346:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587180.076361:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309980032:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.076413:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587180.076434:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788587180.076439:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309979136:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.076462:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587180.076476:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309979648:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.076494:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587180.076512:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309980160:0@lo:400:kworker.0 00000100:00100000:1.0:1788587180.076633:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309979008 00000100:00100000:1.0:1788587180.076641:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309979008 00000100:00100000:1.0:1788587180.076689:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788587180.076697:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309979008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587180.076747:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309979008:12345-0@lo:400:kworker.0 Request processed in 51us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.076755:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788587180.076789:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309980032 00000100:00100000:1.0:1788587180.076820:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309980032 00000100:00100000:1.0:1788587180.076857:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788587180.076863:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309980032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587180.076895:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309980032:12345-0@lo:400:kworker.0 Request processed in 32us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.076901:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788587180.076918:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587180.076928:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309979136 00000100:00100000:1.0:1788587180.076930:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309979136 00000100:00100000:1.0:1788587180.076951:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309979648 00000100:00100000:1.0:1788587180.076953:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309979648 00000100:00100000:1.0:1788587180.076973:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788587180.076978:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309979136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587180.077005:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309979136:12345-0@lo:400:kworker.0 Request processed in 27us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.077010:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788587180.077021:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788587180.077026:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309979648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587180.077064:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309979648:12345-0@lo:400:kworker.0 Request processed in 38us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.077070:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:1.0:1788587180.077086:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587180.077242:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309979264:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.077285:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587180.077314:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309979776:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.077355:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587180.077370:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309980288:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.077396:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587180.077412:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788587180.077417:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309979392:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.077434:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587180.077447:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309979904:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.077467:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587180.077483:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309980416:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.077516:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587180.077702:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587180.077732:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309979008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.077745:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309980032:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.077768:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309979136:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.077777:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309979648:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.077824:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309979776 00000100:00100000:3.0:1788587180.077837:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309979776 00000100:00100000:3.0:1788587180.077865:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309980288 00000100:00100000:3.0:1788587180.077868:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309980288 00000100:00100000:3.0:1788587180.077880:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309979392 00000100:00100000:3.0:1788587180.077882:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309979392 00000100:00100000:3.0:1788587180.077892:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309980160 00000100:00100000:3.0:1788587180.077894:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309980160 00000100:00100000:3.0:1788587180.077906:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788587180.077912:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309979776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.077944:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309979776:12345-0@lo:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.077950:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788587180.077961:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788587180.077966:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309980288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.077987:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309980288:12345-0@lo:400:kworker.0 Request processed in 22us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.077992:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788587180.078001:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788587180.078006:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309979392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.078041:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309979392:12345-0@lo:400:kworker.0 Request processed in 35us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.078047:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788587180.078058:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788587180.078063:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309980160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.078088:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309980160:12345-0@lo:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.078094:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788587180.078123:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309980160:0@lo:400:kworker.0 00000100:00100000:1.0:1788587180.078196:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309979520 00000100:00100000:1.0:1788587180.078201:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309979520 00000100:00100000:1.0:1788587180.078217:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309979264 00000100:00100000:1.0:1788587180.078219:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309979264 00000100:00100000:1.0:1788587180.078229:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788587180.078234:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309979520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587180.078270:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309979520:12345-0@lo:400:kworker.0 Request processed in 35us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.078276:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788587180.078287:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788587180.078293:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309979264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587180.078318:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309979264:12345-0@lo:400:kworker.0 Request processed in 25us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.078323:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1788587180.078340:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587180.078344:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587180.078362:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309979520:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.078452:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309979264:0@lo:400:kworker.0 00010000:00080000:0.0:1788587180.078464:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c1f80 x1875469309979776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587180.078486:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309979776:0@lo:400:kworker.0 00010000:00080000:0.0:1788587180.078498:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c2300 x1875469309980288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587180.078506:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309980288:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.078705:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309979392:0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.079375:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309979904 00000100:00100000:3.0:1788587180.079381:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309979904 00000100:00100000:3.0:1788587180.079421:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309980416 00000100:00100000:3.0:1788587180.079424:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309980416 00000100:00100000:3.0:1788587180.079441:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587180.079448:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309979904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.079497:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309979904:12345-0@lo:400:kworker.0 Request processed in 50us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.079504:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587180.079516:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587180.079531:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309980416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587180.079561:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309980416:12345-0@lo:400:kworker.0 Request processed in 39us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.079567:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788587180.080765:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587180.080774:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587180.080839:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309979904:0@lo:400:kworker.0 00000100:00100000:0.0:1788587180.080854:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309980416:0@lo:400:kworker.0 00000100:00100000:2.0:1788587180.100647:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.100722:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292088832 00000100:00100000:3.0:1788587180.100730:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292088832 00000100:00100000:3.0:1788587180.100785:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:3.0:1788587180.100821:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+41:12411:x1875469292088832:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:3.0:1788587180.100843:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587180.100862:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344360 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a2f expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.100958:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344367 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.100971:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.100995:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587180.101019:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788587180.101269:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344360 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a2f expref: 44 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.101288:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a2f expref: 43 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.101297:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587180.101299:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587180.101302:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3400, rc 0) 00000100:00100000:3.0:1788587180.101452:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+43:12411:x1875469292088832:12345-192.168.203.14@tcp:101:cat.0 Request processed in 658us (811us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788587180.101460:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:1.0:1788587180.104780:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.105636:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292089088 00000100:00100000:3.0:1788587180.105648:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292089088 00000100:00100000:3.0:1788587180.105760:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:3.0:1788587180.105772:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+43:12411:x1875469292089088:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:3.0:1788587180.106751:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+44:12411:x1875469292089088:12345-192.168.203.14@tcp:35:cat.0 Request processed in 976us (1975us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788587180.106761:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:2.0:1788587180.110327:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.110665:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292089216 00000100:00100000:3.0:1788587180.110676:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292089216 00000100:00100000:3.0:1788587180.110740:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:3.0:1788587180.110750:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+44:2412:x1875469292089216:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587180.110776:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587180.110827:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344367 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a2f expref: 44 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.110846:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587180.110851:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587180.110895:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+43:2412:x1875469292089216:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 146us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.110901:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788587180.170831:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587180.171171:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292089472 00000100:00100000:1.0:1788587180.171182:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292089472 00000100:00100000:1.0:1788587180.171310:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 165 00000100:00100000:1.0:1788587180.171321:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+43:12417:x1875469292089472:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:1.0:1788587180.171346:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587180.171360:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788587180.171386:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3e00/0x419e1ae1f63442cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a05 expref: 43 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.171406:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587180.171412:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587180.171426:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344375 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a36 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.171532:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.171546:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 43 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.171554:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.171583:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 43 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.171596:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 43 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587180.171609:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6473:1875469309980544:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587180.172017:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a978d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587180.177221:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6473:1875469309980544:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587180.177255:0:6473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587180.179357:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.179456:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292089600 00000100:00100000:3.0:1788587180.179466:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292089600 00010000:00010000:3.0:1788587180.179607:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 44 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587180.179650:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:3.0:1788587180.179660:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+44:2410:x1875469292089600:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587180.179673:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587180.179680:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 44 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.179694:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 44 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.179715:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634434b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a28 expref: 44 pid: 6472 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.179731:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587180.179748:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.179758:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.179766:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.179899:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587180.179949:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+43:2410:x1875469292089600:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 290us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.179957:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 82 00010000:00010000:1.0:1788587180.180350:0:6473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.180360:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587180.180438:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788587180.180743:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344375 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 44 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.180763:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 43 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.180771:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:0.0:1788587180.180774:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587180.180782:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fa00, rc 0) 00000100:00100000:0.0:1788587180.180892:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+43:12417:x1875469292089472:12345-192.168.203.14@tcp:101:dd.0 Request processed in 9573us (10070us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788587180.180901:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 165 00000100:00100000:0.0:1788587180.183925:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587180.184010:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292089856 00000100:00100000:1.0:1788587180.184020:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292089856 00000100:00100000:1.0:1788587180.184072:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00100000:1.0:1788587180.184081:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+43:12417:x1875469292089856:12345-192.168.203.14@tcp:36:dd.0 00010000:00010000:1.0:1788587180.184332:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.184359:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.184373:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587180.184445:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788587180.184470:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6e088d1 reply state 00000000ce86a98c transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.184482:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.184490:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587180.184493:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587180.184496:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587180.184613:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+46:12417:x1875469292089856:12345-192.168.203.14@tcp:36:dd.0 Request processed in 531us (694us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788587180.184621:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 166 00000020:00080000:1.0:1788587180.184625:0:6472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788587180.405623:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.406978:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292089984 00000100:00100000:3.0:1788587180.406994:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292089984 00000100:00100000:3.0:1788587180.407065:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 167 00000100:00100000:3.0:1788587180.407274:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+46:12431:x1875469292089984:12345-192.168.203.14@tcp:101:stat.0 00010000:00010000:3.0:1788587180.407298:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587180.407318:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344391 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a3d expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407379:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407392:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407406:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407418:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407435:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407441:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407535:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407551:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 47 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407559:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.407603:0:6474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 47 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.408288:0:6474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 47 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587180.408306:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bda4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309980672:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788587180.408400:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062df6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587180.411995:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bda4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309980672:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788587180.412025:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:0.0:1788587180.412026:0:6474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587180.412116:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292090240 00000100:00100000:2.0:1788587180.412123:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292090240 00000100:00100000:2.0:1788587180.412181:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:2.0:1788587180.412311:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+48:6380:x1875469292090240:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788587180.412682:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+49:6380:x1875469292090240:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 491us (673us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788587180.412691:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:0.0:1788587180.418832:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.418954:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292090368 00000100:00100000:3.0:1788587180.418964:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292090368 00010000:00010000:3.0:1788587180.419010:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 49 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587180.419295:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 83 00000100:00100000:3.0:1788587180.419305:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+49:2409:x1875469292090368:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587180.419321:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587180.419328:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 49 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.419341:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 49 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.419361:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f634437c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a36 expref: 49 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.419504:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587180.419510:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.419520:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.419527:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.419562:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587180.419610:0:6474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587180.419623:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+48:2409:x1875469292090368:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 318us (799us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587180.419636:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587180.419637:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 83 00000004:00200000:1.0:1788587180.419685:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788587180.419690:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587180.419712:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.419919:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.419930:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.419937:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.419943:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.419948:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587180.419951:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.419958:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.419968:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587180.419971:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587180.419975:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.419988:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2000/0x419e1ae1f6344398 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420000:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420005:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420011:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420015:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587180.420018:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420023:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420029:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8300) 00010000:00010000:1.0:1788587180.420031:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587180.420034:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420039:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3600/0x419e1ae1f634439f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420255:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f6344391 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a3d expref: 48 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420274:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a3d expref: 47 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.420287:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587180.420290:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587180.420293:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2800, rc 0) 00000100:00100000:1.0:1788587180.420326:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+47:12431:x1875469292089984:12345-192.168.203.14@tcp:101:stat.0 Request processed in 13060us (14712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.420334:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 167 00010000:00010000:3.0:1788587180.459028:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587180.487971:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587180.488078:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292090624 00000100:00100000:0.0:1788587180.488088:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292090624 00000100:00100000:0.0:1788587180.488173:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 168 00000100:00100000:0.0:1788587180.488183:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+47:12437:x1875469292090624:12345-192.168.203.14@tcp:36:truncate.0 00010000:00010000:0.0:1788587180.488237:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587180.488263:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f63443a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a3d expref: 47 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.488281:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:0.0:1788587180.488286:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587180.488490:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.488503:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.488513:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587180.488584:0:6473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788587180.488612:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e66559c reply state 000000003dfaea8b transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.488623:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.488630:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:0.0:1788587180.488632:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587180.488635:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587180.488733:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+49:12437:x1875469292090624:12345-192.168.203.14@tcp:36:truncate.0 Request processed in 552us (770us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788587180.488740:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 168 00000020:00080000:0.0:1788587180.488745:0:6473:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788587180.587276:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309980800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587180.587344:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587180.587660:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309980800 00000100:00100000:2.0:1788587180.587668:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309980800 00000100:00100000:1.0:1788587180.587778:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788587180.587790:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309980800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587180.587833:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587180.587882:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309980800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.587890:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788587180.587937:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309980800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587180.588860:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309980928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587180.588907:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587180.588947:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309980928 00000100:00100000:3.0:1788587180.588952:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309980928 00000100:00100000:3.0:1788587180.588986:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788587180.588996:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309980928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587180.589009:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587180.589061:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309980928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.589069:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788587180.589109:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309980928:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788587180.623939:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1788587180.623956:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:3.0:1788587180.646280:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587180.646431:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292090752 00000100:00100000:2.0:1788587180.646442:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292090752 00000100:00100000:2.0:1788587180.646505:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 169 00000100:00100000:2.0:1788587180.646527:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+49:12451:x1875469292090752:12345-192.168.203.14@tcp:101:stat.0 00010000:00010000:2.0:1788587180.646549:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587180.646570:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f63443b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a44 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646631:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646645:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646656:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646666:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646672:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646679:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646749:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646758:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646765:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587180.646819:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788587180.646823:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587180.646844:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646856:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646863:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646869:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646875:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646880:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587180.646884:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646892:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646903:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587180.646905:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587180.646910:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646916:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63443bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646938:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646943:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646949:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646953:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587180.646956:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646961:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646969:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8300) 00010000:00010000:2.0:1788587180.646972:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587180.646975:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.646980:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.647004:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f63443b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 51 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.647017:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 50 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.647034:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:2.0:1788587180.647036:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587180.647038:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062aea00, rc 0) 00000100:00100000:2.0:1788587180.647095:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+50:12451:x1875469292090752:12345-192.168.203.14@tcp:101:stat.0 Request processed in 570us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587180.647102:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 169 00000100:00100000:2.0:1788587180.742706:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587180.742921:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292091008 00000100:00100000:1.0:1788587180.742931:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292091008 00000100:00100000:1.0:1788587180.743037:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 170 00000100:00100000:1.0:1788587180.743048:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+50:12461:x1875469292091008:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587180.743068:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587180.743088:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f63443d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587180.743198:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788587180.743301:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f63443d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a4b expref: 52 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.743311:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:1.0:1788587180.743313:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587180.743317:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f63443d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a4b expref: 52 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.743328:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f000, rc 0) 00000100:00100000:1.0:1788587180.743403:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+51:12461:x1875469292091008:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 357us (703us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788587180.743410:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 170 00000100:00100000:1.0:1788587180.746271:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.746549:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292091264 00000100:00100000:3.0:1788587180.746624:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292091264 00000100:00100000:3.0:1788587180.746790:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:3.0:1788587180.746940:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+51:12461:x1875469292091264:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587180.747912:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+52:12461:x1875469292091264:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 973us (1759us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788587180.747921:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:3.0:1788587180.794674:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587180.795281:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292091520 00000100:00100000:0.0:1788587180.795293:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292091520 00000100:00100000:0.0:1788587180.795356:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 171 00000100:00100000:0.0:1788587180.795374:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+52:12467:x1875469292091520:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587180.795397:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587180.795418:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63443de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a52 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.795505:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.795520:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 53 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.795546:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.795578:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 53 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.795591:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 53 pid: 8126 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587180.795604:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0815ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6473:1875469309981056:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587180.795688:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587180.797922:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0815ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6473:1875469309981056:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587180.797953:0:6473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587180.798303:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587180.798615:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292091648 00000100:00100000:0.0:1788587180.798622:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292091648 00010000:00010000:0.0:1788587180.798656:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 54 pid: 8126 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587180.798690:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 84 00000100:00100000:0.0:1788587180.798697:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+54:2410:x1875469292091648:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587180.798710:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587180.798726:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 54 pid: 8126 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.798738:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 54 pid: 8126 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.798759:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63443c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a44 expref: 54 pid: 8126 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.798787:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:0.0:1788587180.798830:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.798841:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.798848:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587180.798875:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587180.798915:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+53:2410:x1875469292091648:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 217us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587180.798921:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 84 00010000:00010000:1.0:1788587180.799387:0:6473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.799396:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587180.799412:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788587180.799543:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63443de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 54 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.799558:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 53 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.799575:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587180.799578:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587180.799581:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37104800, rc 0) 00000100:00100000:1.0:1788587180.799608:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+53:12467:x1875469292091520:12345-192.168.203.14@tcp:101:bash.0 Request processed in 4236us (4944us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788587180.799614:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 171 00000100:00100000:0.0:1788587180.802621:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587180.802692:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292091904 00000100:00100000:2.0:1788587180.802703:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292091904 00000100:00100000:2.0:1788587180.802769:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 172 00000100:00100000:2.0:1788587180.802780:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+53:12467:x1875469292091904:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:2.0:1788587180.803086:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.803103:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.803113:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587180.803170:0:8126:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788587180.803195:0:8126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd222cb7 reply state 000000003e52679d transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.803224:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587180.803231:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:2.0:1788587180.803234:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587180.803237:0:8126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587180.803310:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+56:12467:x1875469292091904:12345-192.168.203.14@tcp:36:bash.0 Request processed in 532us (696us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788587180.803318:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 172 00000020:00080000:2.0:1788587180.803322:0:8126:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788587180.809265:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587180.809355:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292092032 00000100:00100000:1.0:1788587180.809373:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292092032 00000100:00100000:1.0:1788587180.809431:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 173 00000100:00100000:1.0:1788587180.809441:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+56:12467:x1875469292092032:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788587180.809462:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587180.809481:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f63443fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.809569:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.809584:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 57 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.809593:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.809623:0:6474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 57 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.809636:0:6474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 57 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587180.809663:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309981184:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587180.810346:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06327a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587180.812301:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309981184:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587180.812327:0:6474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587180.812925:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.813511:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292092160 00000100:00100000:3.0:1788587180.813519:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292092160 00010000:00010000:3.0:1788587180.813555:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 58 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587180.813624:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:3.0:1788587180.813644:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+58:2410:x1875469292092160:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587180.813657:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587180.813664:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 58 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.813676:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 58 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.813697:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f63443e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a52 expref: 58 pid: 6473 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.813713:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587180.813730:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.813740:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.813747:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587180.813772:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587180.814201:0:6474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.814211:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587180.814253:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788587180.814257:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587180.814277:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.814307:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f63443fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a59 expref: 58 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.814322:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a59 expref: 57 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.814330:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587180.814332:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587180.814335:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f200, rc 0) 00000100:00100000:3.0:1788587180.814421:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+57:2410:x1875469292092160:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 777us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587180.814430:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:1.0:1788587180.814705:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+56:12467:x1875469292092032:12345-192.168.203.14@tcp:101:bash.0 Request processed in 5265us (5448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.815248:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 173 00000100:00100000:0.0:1788587180.818660:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.818854:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292092416 00000100:00100000:3.0:1788587180.818864:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292092416 00000100:00100000:3.0:1788587180.818947:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:3.0:1788587180.818958:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+56:12467:x1875469292092416:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:3.0:1788587180.819641:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+57:12467:x1875469292092416:12345-192.168.203.14@tcp:35:bash.0 Request processed in 683us (987us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788587180.819651:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:0.0:1788587180.902907:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587180.902998:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292092672 00000100:00100000:1.0:1788587180.903007:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292092672 00000100:00100000:1.0:1788587180.903075:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 174 00000100:00100000:1.0:1788587180.903084:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+57:12477:x1875469292092672:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587180.903107:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587180.903128:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344408 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a60 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587180.903221:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788587180.903337:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344408 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a60 expref: 59 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.903350:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:1.0:1788587180.903353:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587180.903357:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344408 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a60 expref: 59 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.903383:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f000, rc 0) 00000100:00100000:1.0:1788587180.903439:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+58:12477:x1875469292092672:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 356us (543us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788587180.903446:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 174 00000100:00100000:0.0:1788587180.912466:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587180.912566:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292092800 00000100:00100000:1.0:1788587180.912575:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292092800 00000100:00100000:1.0:1788587180.912631:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 175 00000100:00100000:1.0:1788587180.912641:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+58:12477:x1875469292092800:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:1.0:1788587180.912742:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912760:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912771:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912781:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912787:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912819:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912904:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912913:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912921:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587180.912957:0:6472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912968:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912986:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.912994:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913000:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587180.913004:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913012:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913024:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587180.913027:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587180.913042:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913049:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344416 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913063:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913070:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913076:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913081:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ec00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587180.913089:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913095:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913103:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8300) 00010000:00010000:1.0:1788587180.913106:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587180.913109:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913115:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634441d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913125:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913131:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913136:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913141:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587180.913144:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913158:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913166:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587180.913168:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587180.913177:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.913183:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344424 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587180.913252:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+58:12477:x1875469292092800:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 612us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587180.913260:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 175 00000100:00100000:0.0:1788587180.920703:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587180.920784:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292093056 00000100:00100000:3.0:1788587180.920822:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292093056 00000100:00100000:3.0:1788587180.920872:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:3.0:1788587180.920882:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+58:12477:x1875469292093056:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587180.921338:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+59:12477:x1875469292093056:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 456us (642us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788587180.921347:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:0.0:1788587180.998377:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587180.998512:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292093312 00000100:00100000:1.0:1788587180.998522:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292093312 00000100:00100000:1.0:1788587180.998582:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 176 00000100:00100000:1.0:1788587180.998592:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+59:12480:x1875469292093312:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587180.998612:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587180.998631:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634442b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998718:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998733:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998745:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998755:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998763:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998780:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998921:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998930:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.998938:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587180.998947:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788587180.999031:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999039:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999046:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999053:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ec00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587180.999058:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999067:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999078:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587180.999081:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587180.999092:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999099:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344432 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999114:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999120:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999126:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999131:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587180.999134:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999139:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999156:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8300) 00010000:00010000:1.0:1788587180.999159:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587180.999162:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999168:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999203:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634442b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a67 expref: 62 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999229:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a67 expref: 61 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587180.999236:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587180.999238:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587180.999241:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fa00, rc 0) 00000100:00100000:1.0:1788587180.999301:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+61:12480:x1875469292093312:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 710us (944us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788587180.999309:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 176 00000100:00100000:0.0:1788587181.005048:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587181.005122:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292093440 00000100:00100000:2.0:1788587181.005131:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292093440 00000100:00100000:2.0:1788587181.005204:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 177 00000100:00100000:2.0:1788587181.005215:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+61:12480:x1875469292093440:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:2.0:1788587181.005278:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005295:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005307:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005332:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005348:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005356:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005383:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587181.005388:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005395:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005407:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:2.0:1788587181.005410:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587181.005415:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.005420:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634444e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587181.005499:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+61:12480:x1875469292093440:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 286us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587181.005506:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 177 00000100:00080000:0.0:1788587181.006257:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587181.012352:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587181.012467:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587181.012905:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292093824 00000100:00100000:1.0:1788587181.012916:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292093824 00000100:00100000:1.0:1788587181.012973:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:1.0:1788587181.012984:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+61:12480:x1875469292093824:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788587181.013230:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+62:12480:x1875469292093824:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 247us (761us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788587181.013238:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:3.0:1788587181.017551:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292093568 00000100:00100000:3.0:1788587181.017564:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292093568 00000100:00100000:3.0:1788587181.017623:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:3.0:1788587181.017631:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+62:2409:x1875469292093568:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587181.017646:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587181.017667:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a67 expref: 62 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.017686:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587181.017691:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587181.017760:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+61:2409:x1875469292093568:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 129us (5422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587181.017767:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000001:00080000:2.0:1788587181.139598:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000001:00080000:2.0:1788587181.139718:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:2.0:1788587181.139740:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf3a978a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788587181.139752:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf37181e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf3a9783c0 00000020:00080000:2.0:1788587181.139756:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf37181f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe057e4000 00000004:00080000:2.0:1788587181.139842:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:0.0:1788587181.140059:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587181.140082:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587181.140090:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587181.140104:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587181.140109:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587181.140118:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587181.140134:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:0.0:1788587181.140137:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587181.140142:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587181.140157:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63443f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587181.140352:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587181.140374:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309981312:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788587181.140428:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587181.140486:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309981312 00000100:00100000:2.0:1788587181.140493:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309981312 00000100:00100000:2.0:1788587181.140535:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587181.140543:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309981312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788587181.140564:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1788587181.140590:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bacab, atime: 0x6a9bacab, ctime: 0x6a9bacab, blocks: 0xb 00010000:00010000:2.0:1788587181.140596:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.140610:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1788587181.140614:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587181.140620:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.140634:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.140642:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.140649:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.140663:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1788587181.141447:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788587181.141573:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788587181.141814:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469309981312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1249us (1363us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788587181.141822:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788587181.141853:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788587181.141867:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587181.141873:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.141883:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587181.141888:0:6461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.142016:0:6461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.142043:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.142051:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344455 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.142077:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587181.142079:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587181.142081:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587181.142639:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142659:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142665:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142670:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587181.142674:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142681:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142691:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cbf07fc8f00) 00010000:00010000:3.0:1788587181.142694:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587181.142698:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142704:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634424f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142720:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142726:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142732:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142737:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fe00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587181.142754:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142761:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142769:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:3.0:1788587181.142771:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587181.142774:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.142780:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344256 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143003:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143011:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143017:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143074:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587181.143078:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143086:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143094:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8300) 00010000:00010000:3.0:1788587181.143096:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587181.143173:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143179:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344295 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143196:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143203:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143209:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143214:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587181.143217:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143223:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143230:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587181.143233:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587181.143236:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143242:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634438a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143252:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143258:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143270:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143275:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587181.143278:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143284:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143291:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587181.143294:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587181.143296:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.143302:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f63443ad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587181.143481:0:3475:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788587181.143486:0:3475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967307 00000100:00100000:1.0:1788587181.143512:0:3475:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbf3fdb3800 x1875469309981312/t4294967308(4294967308) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587197 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788587181.143523:0:3475:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbf3fdb3800/2, rc 0, transno 4294967308 00000100:00100000:1.0:1788587181.143529:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309981312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788587181.148090:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587181.148165:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292094080 00000100:00100000:2.0:1788587181.148175:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292094080 00000100:00100000:2.0:1788587181.148229:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 178 00000100:00100000:2.0:1788587181.148239:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+16:12498:x1875469292094080:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:2.0:1788587181.148261:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587181.148281:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634445c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a6e expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.148493:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6344463 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.148508:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6344463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.148519:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6344463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587181.148529:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788587181.148675:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634445c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a6e expref: 19 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.148692:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6344463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a6e expref: 18 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.148699:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:2.0:1788587181.148702:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788587181.148706:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062aea00, rc 0) 00000100:00100000:2.0:1788587181.148824:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+18:12498:x1875469292094080:12345-192.168.203.14@tcp:101:cat.0 Request processed in 557us (711us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788587181.148832:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 178 00000100:00100000:1.0:1788587181.170775:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587181.170928:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292094208 00000100:00100000:2.0:1788587181.170938:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292094208 00000100:00100000:1.0:1788587181.171020:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 179 00000100:00100000:1.0:1788587181.171034:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+18:12499:x1875469292094208:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587181.171058:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587181.171077:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a75 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.171132:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344478 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.171226:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.171237:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587181.171266:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788587181.171268:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587181.171281:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.171299:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a75 expref: 20 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.171313:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344478 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a75 expref: 19 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.171320:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587181.171322:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587181.171336:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499ec00, rc 0) 00000100:00100000:1.0:1788587181.171381:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+19:12499:x1875469292094208:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 353us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587181.171386:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 179 00000100:00100000:0.0:1788587181.174633:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587181.174890:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292094592 00000100:00100000:3.0:1788587181.174899:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292094592 00000100:00100000:3.0:1788587181.175101:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788587181.175112:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+19:12499:x1875469292094592:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587181.175420:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+20:12499:x1875469292094592:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 309us (792us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788587181.175429:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:0.0:1788587181.178042:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587181.178223:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292094720 00000100:00100000:3.0:1788587181.178230:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292094720 00000100:00100000:3.0:1788587181.178280:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788587181.178290:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+20:12499:x1875469292094720:12345-192.168.203.14@tcp:103:lfs.0 00010000:00010000:3.0:1788587181.178317:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788587181.178341:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f6344401 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a59 expref: 20 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.178374:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f6344463 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a6e expref: 19 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.178388:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634430c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a1a expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.178399:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8200) 00010000:00010000:3.0:1788587181.178409:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587181.178451:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+17:12499:x1875469292094720:12345-192.168.203.14@tcp:103:lfs.0 Request processed in 163us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587181.178469:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:0.0:1788587181.180703:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587181.181224:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292094848 00000100:00100000:1.0:1788587181.181232:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292094848 00000100:00100000:1.0:1788587181.181284:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 180 00000100:00100000:1.0:1788587181.181293:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+17:12499:x1875469292094848:12345-192.168.203.14@tcp:58:lfs.0 00010000:00010000:1.0:1788587181.181404:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.181421:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.181431:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587181.182007:0:6472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788587181.182092:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+17:12499:x1875469292094848:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 799us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587181.182101:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 180 00000100:00100000:0.0:1788587181.207892:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587181.207952:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587181.207968:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292094976 00000100:00100000:2.0:1788587181.207977:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292094976 00000100:00100000:0.0:1788587181.208033:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587181.208049:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 385 00000100:00100000:2.0:1788587181.208058:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292094976:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587181.208083:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587181.208157:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292094976:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 88us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587181.208166:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 385 00000100:00100000:2.0:1788587181.208205:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292095488 00000100:00100000:2.0:1788587181.208209:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292095488 00000100:00100000:2.0:1788587181.208252:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292095104 00000100:00100000:2.0:1788587181.208256:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292095104 00000100:00100000:2.0:1788587181.208284:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 300 00000100:00100000:2.0:1788587181.208291:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292095488:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587181.208334:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292095488:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 44us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587181.208349:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 300 00000100:00100000:2.0:1788587181.208365:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 301 00000100:00100000:2.0:1788587181.208371:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292095104:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587181.208403:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292095104:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587181.208416:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 301 00000100:00080000:2.0:1788587181.208433:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587181.208437:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587181.209326:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587181.209367:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587181.209421:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292095232 00000100:00100000:1.0:1788587181.209428:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292095232 00000100:00100000:1.0:1788587181.209472:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292095360 00000100:00100000:1.0:1788587181.209475:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292095360 00000100:00080000:0.0:1788587181.209485:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587181.209488:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587181.209496:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 149 00000100:00100000:1.0:1788587181.209504:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292095232:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587181.209549:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292095232:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 46us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587181.209565:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 149 00000100:00100000:1.0:1788587181.209583:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:1.0:1788587181.209589:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292095360:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587181.209618:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292095360:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587181.209625:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:3.0:1788587181.209883:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292095616 00000100:00100000:3.0:1788587181.209887:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292095616 00000100:00100000:3.0:1788587181.209945:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 302 00000100:00100000:3.0:1788587181.209952:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292095616:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587181.209986:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292095616:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587181.209993:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 302 00000100:00080000:0.0:1788587181.210780:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587181.212372:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587181.212456:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292095744 00000100:00100000:2.0:1788587181.212464:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292095744 00000100:00100000:2.0:1788587181.212519:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 181 00000100:00100000:2.0:1788587181.212528:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+17:12501:x1875469292095744:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587181.212546:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587181.212566:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f6344486 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a7c expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.212655:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.212670:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.212681:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.212696:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.212703:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.212710:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213601:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213614:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213623:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587181.213660:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788587181.213664:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587181.213684:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213706:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213716:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213723:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213729:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213735:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afe00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587181.213739:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213746:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213758:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587181.213762:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587181.213766:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213772:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f634448d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213785:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.213791:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.219619:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.219625:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587181.219631:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.219641:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.219658:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf03491100) 00010000:00010000:2.0:1788587181.219666:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587181.219671:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.219678:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae800/0x419e1ae1f6344494 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.219781:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f6344486 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 19 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.219818:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 18 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.219827:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8600) 00010000:00010000:2.0:1788587181.219829:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587181.219832:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062afa00, rc 0) 00000100:00100000:2.0:1788587181.219909:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+18:12501:x1875469292095744:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 7381us (7542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587181.219934:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 181 00010000:00010000:2.0:1788587181.486361:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587181.611291:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309981440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587181.611370:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587181.611568:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309981440 00000100:00100000:3.0:1788587181.611575:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309981440 00000100:00100000:3.0:1788587181.611629:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788587181.611639:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309981440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587181.611685:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587181.617481:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309981440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5834us (6101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587181.617495:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788587181.617602:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309981568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587181.617660:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587181.617759:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587181.617766:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309981696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587181.617812:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587181.620333:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309981440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587181.620524:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309981568 00000100:00100000:1.0:1788587181.620532:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309981568 00000100:00100000:1.0:1788587181.620590:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788587181.620599:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309981568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587181.620635:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587181.620706:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309981568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587181.620713:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788587181.620754:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309981568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587181.621255:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309981696 00000100:00100000:0.0:1788587181.621261:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309981696 00000100:00100000:0.0:1788587181.621303:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587181.621311:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309981696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587181.621328:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587181.621531:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309981696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 220us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587181.621537:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788587181.621597:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309981696:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788587181.931625:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587181.931633:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587181.933498:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788587181.933513:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587181.933675:0:13326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309981824:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587181.933906:0:13326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf063270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587181.937907:0:13326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309981824:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587181.949611:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587181.950111:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292095872 00000100:00100000:1.0:1788587181.950122:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292095872 00000100:00100000:1.0:1788587181.950186:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 182 00000100:00100000:1.0:1788587181.950198:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292095872:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587181.950228:0:13560:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587181.950333:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292095872:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 137us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587181.950341:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 182 00000100:00100000:0.0:1788587181.964154:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587181.964257:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292096000 00000100:00100000:3.0:1788587181.964268:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292096000 00000100:00100000:3.0:1788587181.964362:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 183 00000100:00100000:3.0:1788587181.964373:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292096000:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788587181.964447:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964464:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964481:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964499:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964507:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964515:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964542:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964551:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964566:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587181.964603:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788587181.964607:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587181.964619:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964630:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964637:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964644:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964649:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587181.964654:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964662:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964674:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:3.0:1788587181.964678:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587181.964682:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964917:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2a00/0x419e1ae1f63444a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964939:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964945:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964950:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964955:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587181.964958:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964964:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964973:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8cbf02c76900) 00010000:00010000:3.0:1788587181.964975:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587181.964979:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964983:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63444a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.964998:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.965004:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.965009:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.965019:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587181.965022:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.965028:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.965036:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8600) 00010000:00010000:3.0:1788587181.965038:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587181.965041:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587181.965046:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f63444b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587181.965116:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292096000:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 744us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587181.965123:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 183 00000100:00100000:0.0:1788587181.969159:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587181.969727:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292096256 00000100:00100000:2.0:1788587181.969737:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292096256 00000100:00100000:2.0:1788587181.969820:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:2.0:1788587181.969832:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292096256:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587181.969854:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587181.969874:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f63444b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a83 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970151:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970168:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970179:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587181.970190:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788587181.970282:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970290:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970311:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970317:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587181.970321:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970328:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970338:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8600) 00010000:00010000:2.0:1788587181.970342:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587181.970346:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970476:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f63444be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970520:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f63444b7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a83 expref: 20 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970531:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:2.0:1788587181.970533:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587181.970537:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f63444b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a83 expref: 20 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587181.970547:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062afc00, rc 0) 00000100:00100000:2.0:1788587181.970612:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+19:12512:x1875469292096256:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 781us (1472us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788587181.970629:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:2.0:1788587181.976736:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587181.977041:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292096384 00000100:00100000:3.0:1788587181.977050:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292096384 00000100:00100000:3.0:1788587181.977109:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:3.0:1788587181.977119:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+19:12512:x1875469292096384:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788587181.977164:0:6472:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587181.977263:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+19:12512:x1875469292096384:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 144us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587181.977271:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:3.0:1788587181.981767:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587181.984201:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292096640 00000100:00100000:1.0:1788587181.984214:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292096640 00000100:00100000:1.0:1788587181.984275:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:1.0:1788587181.984286:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:12512:x1875469292096640:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587181.984308:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587181.984311:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788587181.984337:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344478 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a75 expref: 19 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.984364:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587181.984370:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587181.984383:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a8a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587181.985567:0:6473:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788587181.986326:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63444d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.986343:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63444d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.986408:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63444d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.986468:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a8a expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.986484:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63444d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a8a expref: 20 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587181.986493:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:1.0:1788587181.986496:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587181.986499:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e800, rc 0) 00000100:00100000:1.0:1788587181.986598:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+20:12512:x1875469292096640:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 2313us (4845us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788587181.986606:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:2.0:1788587182.000429:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587182.000524:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292096896 00000100:00100000:0.0:1788587182.000534:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292096896 00000100:00100000:0.0:1788587182.000623:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 187 00000100:00100000:0.0:1788587182.000634:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+20:12512:x1875469292096896:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587182.000705:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587182.000743:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63444d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a8a expref: 20 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.000759:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:0.0:1788587182.000769:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587182.000816:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.000842:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.000853:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.000910:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.000919:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.000926:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001133:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001151:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001158:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001164:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587182.001169:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001176:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001185:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:0.0:1788587182.001194:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587182.001199:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001205:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63444e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001216:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001222:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001228:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001234:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587182.001236:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001242:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001250:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8615cc44 (ffff8cbf2c8bef00) 00010000:00010000:0.0:1788587182.001253:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587182.001256:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.001261:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f63444e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8615cc44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.001342:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+19:12512:x1875469292096896:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 709us (1330us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788587182.001367:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 187 00000100:00100000:0.0:1788587182.014218:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587182.014282:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292097024 00000100:00100000:1.0:1788587182.014292:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292097024 00000100:00100000:1.0:1788587182.014346:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 188 00000100:00100000:1.0:1788587182.014460:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+19:12512:x1875469292097024:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587182.014482:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587182.014506:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a91 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.014559:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.014574:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.014586:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.014746:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 21 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.014766:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 20 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.014775:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:1.0:1788587182.014779:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788587182.014782:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499ec00, rc 0) 00000100:00100000:1.0:1788587182.015827:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+20:12512:x1875469292097024:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1467us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587182.015837:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 188 00000100:00100000:2.0:1788587182.028408:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587182.028526:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292097280 00000100:00100000:1.0:1788587182.028536:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292097280 00000100:00100000:1.0:1788587182.028593:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 189 00000100:00100000:1.0:1788587182.028602:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+20:12512:x1875469292097280:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587182.028693:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.028721:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.028734:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587182.029476:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788587182.029488:0:6473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379778693620ns, next at 380778691380ns, rc = 0 00000004:00010000:1.0:1788587182.029572:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083abd033 reply state 00000000f0e728cb transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.029588:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.029595:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:1.0:1788587182.029598:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788587182.029601:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587182.029882:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+22:12512:x1875469292097280:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 1278us (1480us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788587182.029890:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 189 00000100:00100000:2.0:1788587182.034072:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587182.034229:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292097408 00000100:00100000:0.0:1788587182.034239:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292097408 00000100:00100000:0.0:1788587182.034299:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 190 00000100:00100000:0.0:1788587182.034309:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+22:12512:x1875469292097408:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587182.034334:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587182.034355:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a98 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.034424:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 23 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.034440:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 23 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.034458:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:0.0:1788587182.034461:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587182.034465:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105a00, rc 0) 00000100:00100000:0.0:1788587182.034520:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+23:12512:x1875469292097408:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 212us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587182.034526:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 190 00000100:00100000:2.0:1788587182.037451:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587182.037620:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292097536 00000100:00100000:0.0:1788587182.037631:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292097536 00000100:00100000:0.0:1788587182.037758:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:0.0:1788587182.037769:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2412:x1875469292097536:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788587182.038373:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2412:x1875469292097536:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 603us (930us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788587182.038381:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:1.0:1788587182.067926:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587182.068153:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292097792 00000100:00100000:0.0:1788587182.068163:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292097792 00000100:00100000:0.0:1788587182.068253:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:0.0:1788587182.068265:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+23:12512:x1875469292097792:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587182.068521:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+24:12512:x1875469292097792:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 258us (604us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788587182.068529:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:1.0:1788587182.078134:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587182.078189:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292098048 00000100:00100000:1.0:1788587182.078199:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292098048 00000100:00100000:1.0:1788587182.078273:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 191 00000100:00100000:1.0:1788587182.078283:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+24:12512:x1875469292098048:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788587182.078394:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+24:12512:x1875469292098048:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 113us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587182.078412:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 191 00000100:00100000:1.0:1788587182.082336:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587182.082434:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292098176 00000100:00100000:3.0:1788587182.082451:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292098176 00000100:00100000:3.0:1788587182.082550:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 192 00000100:00100000:3.0:1788587182.082561:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+24:12512:x1875469292098176:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587182.082580:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587182.082599:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634450b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5a9f expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.082665:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f6344512 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.082680:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f6344512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.082693:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f6344512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587182.082727:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587182.082745:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f6344512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.082771:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634450b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a9f expref: 26 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.082787:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f6344512 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a9f expref: 25 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.082813:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:3.0:1788587182.082816:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788587182.082820:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2400, rc 0) 00000100:00100000:3.0:1788587182.082871:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+25:12512:x1875469292098176:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 312us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587182.082884:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 192 00000100:00100000:1.0:1788587182.085229:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000040:00080000:2.0:1788587182.085237:0:14212:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587182.085243:0:14212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788587182.085279:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292098304 00000100:00100000:3.0:1788587182.085289:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292098304 00000040:00080000:2.0:1788587182.085299:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788587182.085308:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587182.085362:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:3.0:1788587182.085374:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292098304:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587182.085390:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587182.085407:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5aa6 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587182.085429:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bacad, blocks: 0x1 00010000:00010000:3.0:1788587182.085446:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1788587182.085451:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587182.085461:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 8 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.085480:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 8 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.085492:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2a00, rc 0) 00000100:00100000:3.0:1788587182.085551:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292098304:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 179us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587182.085558:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:1.0:1788587182.088223:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587182.088272:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292098560 00000100:00100000:0.0:1788587182.088281:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292098560 00000100:00100000:0.0:1788587182.088342:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:0.0:1788587182.088353:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+25:12512:x1875469292098560:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587182.088465:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+25:12512:x1875469292098560:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587182.088474:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:0.0:1788587182.093322:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587182.093501:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292098688 00000100:00100000:2.0:1788587182.093522:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292098688 00000100:00100000:2.0:1788587182.093572:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:2.0:1788587182.093579:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:12512:x1875469292098688:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587182.093593:0:8100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587182.093607:0:8100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5aad expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.093633:0:8100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 9 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.093640:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587182.093644:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587182.093648:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 9 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.093683:0:8100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 9 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.093695:0:8100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 9 pid: 8101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587182.093707:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8100:1875469309981952:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587182.093811:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587182.099626:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8100:1875469309981952:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788587182.099662:0:8100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 9 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.099782:0:8100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae200, rc 0) 00000100:00100000:3.0:1788587182.099854:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+9:12512:x1875469292098688:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 6272us (6540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587182.099863:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:1.0:1788587182.103566:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587182.103629:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292098816 00000100:00100000:0.0:1788587182.103639:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292098816 00010000:00010000:0.0:1788587182.103678:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 9 pid: 8101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.103718:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:0.0:1788587182.103728:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+9:2411:x1875469292098816:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587182.103748:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587182.103834:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 9 pid: 8101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.103850:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 9 pid: 8101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.103883:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c699f3a2/0x419e1ae1f6344519 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aa6 expref: 9 pid: 8101 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.103896:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587182.103900:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587182.103908:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.103917:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.104009:0:6458:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.104023:0:6458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6458:1875469309982080:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788587182.104102:0:6458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587182.109518:0:6458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6458:1875469309982080:192.168.203.14@tcp:105: 00010000:00010000:1.0:1788587182.109544:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587182.109603:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2411:x1875469292098816:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 5875us (6043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587182.109616:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:1.0:1788587182.109787:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587182.109848:0:8107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292098944 00000100:00100000:1.0:1788587182.109854:0:8107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292098944 00002000:00100000:1.0:1788587182.109898:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8cbf340c0000 x1875469292098944/t0(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:498/0 lens 504/0 e 0 to 0 dl 1788587193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587182.109909:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf340c0000 with x1875469292098944 ext(0->8) 00002000:00010000:1.0:1788587182.110436:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbf340c0000 00000100:00100000:1.0:1788587182.110468:0:8107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:1.0:1788587182.110479:0:8107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+8:2411:x1875469292098944:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788587182.110922:0:8107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+10:2411:x1875469292098944:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 Request processed in 444us (1136us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788587182.110933:0:8107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00002000:00100000:1.0:1788587182.110941:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8cbf340c0000 x1875469292098944/t4294967315(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:498/0 lens 504/448 e 0 to 0 dl 1788587193 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587182.110961:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf340c0000 with x1875469292098944 ext(0->8) 00002000:00010000:1.0:1788587182.110965:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbf340c0000 00000100:00100000:1.0:1788587182.114904:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587182.114999:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292099072 00000100:00100000:3.0:1788587182.115009:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292099072 00000100:00100000:3.0:1788587182.115231:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 194 00000100:00100000:3.0:1788587182.115244:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+25:12512:x1875469292099072:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788587182.125874:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587182.125897:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309982208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587182.125959:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587182.126057:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309982208 00000100:00100000:0.0:1788587182.126066:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309982208 00000100:00100000:0.0:1788587182.126337:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788587182.126360:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309982208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587182.126409:0:6477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587182.126511:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309982208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587182.126518:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788587182.126564:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309982208:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1788587182.154646:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00010000:00010000:0.0:1788587182.154666:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587182.154675:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1788587182.154680:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.154690:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788587182.154695:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1788587182.154698:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587182.154705:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.154714:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.154731:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:0.0:1788587182.154735:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587182.154740:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.154748:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f63444fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788587182.154854:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788587182.154865:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788587182.154878:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309982336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788587182.154909:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292099072:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 39666us (40012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587182.154921:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 194 00000100:00100000:0.0:1788587182.154941:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587182.154981:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309982336 00000100:00100000:2.0:1788587182.154989:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309982336 00000100:00100000:2.0:1788587182.155047:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788587182.155058:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309982336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788587182.155205:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788587182.155208:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788587181 00002000:00010000:2.0:1788587182.155210:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788587182.155211:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788587181 -> 1788587181 00002000:00010000:2.0:1788587182.155213:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788587182.155245:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469309982336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (305us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788587182.155249:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788587182.155269:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788587182.155291:0:3475:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbf3fdb3480/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788587182.155295:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309982336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788587182.157323:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587182.157373:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292099200 00000100:00100000:3.0:1788587182.157454:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292099200 00000100:00100000:3.0:1788587182.157542:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:3.0:1788587182.157564:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+10:2409:x1875469292099200:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788587182.178249:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1788587182.178277:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1788587182.178288:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:2.0:1788587182.178484:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292099200:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 20927us (21161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587182.178496:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:1.0:1788587182.181680:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587182.181756:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292099456 00000100:00100000:2.0:1788587182.181767:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292099456 00000100:00100000:2.0:1788587182.181846:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:2.0:1788587182.181854:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292099456:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587182.181900:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587182.181921:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f6344512 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a9f expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.181934:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:2.0:1788587182.181938:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587182.181961:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.181971:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.181977:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587182.182233:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6922bb1 reply state 00000000b1610939 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.182265:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.182271:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:2.0:1788587182.182274:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587182.182277:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587182.182376:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:12512:x1875469292099456:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 520us (702us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788587182.182383:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:0.0:1788587182.183845:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587182.183929:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292099584 00000100:00100000:2.0:1788587182.183938:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292099584 00000100:00100000:2.0:1788587182.183988:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:2.0:1788587182.183996:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292099584:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788587182.184417:0:8101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788587182.184421:0:8101:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788587181 -> 1788587180 00002000:00010000:2.0:1788587182.184425:0:8101:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788587179 00002000:00010000:2.0:1788587182.184427:0:8101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788587181 -> 1788587180 00002000:00010000:2.0:1788587182.184428:0:8101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788587182.184475:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292099584:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 479us (637us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788587182.184482:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:2.0:1788587182.187554:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587182.187644:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292099840 00000100:00100000:3.0:1788587182.187653:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292099840 00000100:00100000:3.0:1788587182.187716:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 196 00000100:00100000:3.0:1788587182.187735:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+19:12512:x1875469292099840:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788587182.187960:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.187978:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 19 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.187997:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.188045:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 19 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.188061:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 19 pid: 8126 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587182.188075:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309982464:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788587182.188192:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833480 going to sleep for 11 seconds 00000040:00080000:0.0:1788587182.188556:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587182.191238:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587182.191463:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292099968 00000100:00100000:0.0:1788587182.191473:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292099968 00010000:00010000:0.0:1788587182.191516:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 20 pid: 8126 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.191554:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 87 00000100:00100000:0.0:1788587182.191564:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+20:2410:x1875469292099968:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587182.191580:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587182.191588:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 20 pid: 8126 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.191602:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 20 pid: 8126 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.191625:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:0.0:1788587182.191631:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.191642:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.191650:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191659:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f63444f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a91 expref: 20 pid: 8126 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587182.191686:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309982464:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587182.191709:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587182.191711:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191721:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191727:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191770:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191778:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.191782:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+19:2410:x1875469292099968:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 218us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587182.191790:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 87 00010000:00010000:3.0:1788587182.191828:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191835:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587182.191839:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191848:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191859:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:3.0:1788587182.191862:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788587182.191866:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.191873:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634452e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587182.191918:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292099840:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 Request processed in 4185us (4371us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788587182.191928:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 196 00000100:00100000:3.0:1788587182.197007:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587182.197236:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292100096 00000100:00100000:2.0:1788587182.197246:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292100096 00000100:00100000:2.0:1788587182.197296:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:2.0:1788587182.197306:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2412:x1875469292100096:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788587182.198923:0:8100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.198953:0:8100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.198962:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587182.198967:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587182.198973:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.199019:0:8100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.199038:0:8100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 8 pid: 8100 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587182.199054:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8100:1875469309982592:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587182.199164:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587182.202712:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587182.202754:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8100:1875469309982592:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587182.202782:0:8100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587182.203031:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292100224 00000100:00100000:1.0:1788587182.203037:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292100224 00010000:00010000:1.0:1788587182.203074:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 9 pid: 8100 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587182.203325:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 88 00000100:00100000:1.0:1788587182.203336:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf049c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+9:2410:x1875469292100224:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587182.203450:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587182.203472:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 9 pid: 8100 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.203488:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 9 pid: 8100 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.203527:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba794b40/0x419e1ae1f6344520 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aad expref: 9 pid: 8100 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.203542:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587182.203547:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587182.203553:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.203562:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.203761:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587182.203826:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf049c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292100224:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 490us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587182.203834:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 88 00010000:00010000:1.0:1788587182.204928:0:8100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.204942:0:8100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.204972:0:8100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.204980:0:8100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.204995:0:8100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.205002:0:8100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587182.205007:0:8100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.205016:0:8100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.205095:0:8100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.205104:0:8100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344535 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587182.205227:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2412:x1875469292100096:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 7920us (8227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587182.205237:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:2.0:1788587182.208277:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587182.208393:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292100480 00000100:00100000:3.0:1788587182.208403:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292100480 00000100:00100000:3.0:1788587182.208464:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 197 00000100:00100000:3.0:1788587182.208475:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:12512:x1875469292100480:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788587182.208583:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.208614:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.208626:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.208868:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.208881:0:6472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 19 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.208890:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.208926:0:6472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 19 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.208941:0:6472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 19 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587182.208956:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309982720:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788587182.209450:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587182.212467:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587182.212529:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309982720:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587182.212556:0:6472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.212716:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292100608 00000100:00100000:0.0:1788587182.212725:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292100608 00010000:00010000:0.0:1788587182.212957:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 20 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.213147:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 89 00000100:00100000:0.0:1788587182.213159:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+20:2409:x1875469292100608:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587182.213174:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587182.213183:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 20 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.213197:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 20 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.213223:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105a00/0x419e1ae1f6344504 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a98 expref: 20 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.213241:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:0.0:1788587182.213247:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.213257:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.213278:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.213637:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587182.213638:0:6472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.213655:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.213697:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+19:2409:x1875469292100608:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 540us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587182.213706:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 89 00000001:00080000:1.0:1788587182.213925:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788587182.214064:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788587182.214109:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788587182.214203:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6472:1875469309982848:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788587182.214267:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587182.214301:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587182.214563:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309982848 00000100:00100000:3.0:1788587182.214571:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309982848 00000100:00100000:3.0:1788587182.214617:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788587182.214626:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6472:x1875469309982848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788587182.214699:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6472:x1875469309982848:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587182.214715:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788587182.214956:0:6472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788587182.214961:0:6472:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbf3fdb3480, transno 4294967316 00000100:00100000:1.0:1788587182.214976:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6472:1875469309982848:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788587182.215777:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788587182.215846:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08158700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6472:1875469309982976:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788587182.215888:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587182.215909:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587182.216213:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309982976 00000100:00100000:3.0:1788587182.216221:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309982976 00000100:00100000:3.0:1788587182.216261:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788587182.216271:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6472:x1875469309982976:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788587182.216924:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6472:x1875469309982976:12345-0@lo:1000:mdt00_000.0 Request processed in 653us (1032us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788587182.216934:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788587182.216948:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08158700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6472:1875469309982976:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788587182.216977:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.216984:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.216990:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.216994:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587182.216998:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217009:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217029:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:1.0:1788587182.217032:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587182.217035:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217040:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344543 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217057:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217063:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217070:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217075:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587182.217077:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217083:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217091:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8600) 00010000:00010000:1.0:1788587182.217093:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587182.217098:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217114:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f634447f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217150:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217162:0:6472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 22 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217170:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217195:0:6472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 22 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587182.217208:0:6472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 22 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587182.217220:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309983104:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587182.217295:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587182.219619:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587182.219713:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309983104:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587182.219744:0:6472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.219927:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292100736 00000100:00100000:0.0:1788587182.219935:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292100736 00010000:00010000:0.0:1788587182.219976:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 23 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587182.220013:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:0.0:1788587182.220024:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+23:2409:x1875469292100736:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587182.220037:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587182.220045:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 23 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.220057:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 23 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.220079:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634449b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5a7c expref: 23 pid: 6474 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.220093:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8600) 00010000:00010000:0.0:1788587182.220098:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.220123:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.220131:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587182.220167:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587182.220216:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+22:2409:x1875469292100736:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 193us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587182.220223:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 90 00010000:00010000:2.0:1788587182.220277:0:6472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220296:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220309:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220316:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220321:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220327:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587182.220332:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220339:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220363:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8600) 00010000:00010000:2.0:1788587182.220367:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587182.220370:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220376:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634454a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220387:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220393:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220404:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220409:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587182.220412:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220417:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220424:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8600) 00010000:00010000:2.0:1788587182.220426:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587182.220429:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.220434:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634453c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587182.220654:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:12512:x1875469292100480:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 12179us (12386us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788587182.220664:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 197 00000020:00080000:2.0:1788587182.220668:0:6472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788587182.220751:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587182.220755:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587182.221066:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788587182.221072:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587182.224063:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587182.224190:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292100992 00000100:00100000:3.0:1788587182.224200:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292100992 00000100:00100000:3.0:1788587182.224242:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:3.0:1788587182.224249:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:12512:x1875469292100992:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788587182.224907:0:6475:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788587182.225220:0:6475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788587182.225266:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.225284:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.225295:0:6475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.225303:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.225309:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.225326:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587182.225430:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587182.225530:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+23:12512:x1875469292100992:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 1277us (1472us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788587182.225538:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000020:00080000:3.0:1788587182.225543:0:6475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788587182.226114:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587182.226122:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.226130:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587182.226135:0:8116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.226167:0:8116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.226180:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:2.0:1788587182.226182:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587182.226186:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.226190:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f6344551 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587182.226199:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587182.226200:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587182.226201:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587182.512318:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587183.531933:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587184.053652:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587184.053661:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587184.053696:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788587184.053714:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587184.187737:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587184.187787:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292101248 00000100:00100000:3.0:1788587184.187822:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292101248 00000100:00100000:3.0:1788587184.187907:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 198 00000100:00100000:3.0:1788587184.187920:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+23:12530:x1875469292101248:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587184.187949:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587184.188029:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3c00/0x419e1ae1f6344558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ab4 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.188132:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f634455f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.188147:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f634455f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.188159:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f634455f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587184.188170:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788587184.188296:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3c00/0x419e1ae1f6344558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ab4 expref: 26 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.188321:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f634455f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ab4 expref: 25 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.188330:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:3.0:1788587184.188333:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587184.188350:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2200, rc 0) 00000100:00100000:3.0:1788587184.188406:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+25:12530:x1875469292101248:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 490us (679us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788587184.188413:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 198 00000100:00080000:3.0:1788587184.188435:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587184.190903:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587184.191091:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292101376 00000100:00100000:3.0:1788587184.191099:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292101376 00000100:00100000:3.0:1788587184.191168:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 199 00000100:00100000:3.0:1788587184.191179:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+25:12530:x1875469292101376:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:3.0:1788587184.191242:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191258:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191269:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191285:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191292:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191314:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191516:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191525:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191532:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587184.191564:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191575:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191581:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191588:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191594:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587184.191598:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191605:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191615:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:3.0:1788587184.191623:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587184.191627:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191634:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3800/0x419e1ae1f634456d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191645:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191650:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191656:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191661:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587184.191663:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191669:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191675:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf02c76400) 00010000:00010000:3.0:1788587184.191677:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587184.191680:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191685:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344574 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191697:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191706:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191712:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191717:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587184.191719:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191725:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191731:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:3.0:1788587184.191733:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587184.191735:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.191740:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f634457b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587184.191819:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+25:12530:x1875469292101376:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 641us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587184.191826:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 199 00000100:00100000:0.0:1788587184.247244:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587184.247320:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292101632 00000100:00100000:1.0:1788587184.247351:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292101632 00000100:00100000:1.0:1788587184.247410:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 200 00000100:00100000:1.0:1788587184.247421:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+25:12533:x1875469292101632:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587184.247441:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587184.247472:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344582 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5abb expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247545:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247560:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247573:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247586:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247593:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247599:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247874:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247883:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.247891:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587184.247909:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788587184.248003:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248010:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248016:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248022:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587184.248026:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248034:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248045:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587184.248048:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587184.248052:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248057:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f6344589 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248068:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248074:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248087:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248091:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587184.248094:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248100:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248107:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:1.0:1788587184.248110:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587184.248113:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248118:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f6344590 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248166:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344582 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 28 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248179:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 27 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.248187:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:1.0:1788587184.248189:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587184.248192:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499ec00, rc 0) 00000100:00100000:1.0:1788587184.248248:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+27:12533:x1875469292101632:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 828us (1011us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788587184.248264:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 200 00000100:00100000:1.0:1788587184.255861:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587184.255899:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292101760 00000100:00100000:1.0:1788587184.255909:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292101760 00000100:00100000:1.0:1788587184.255960:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 201 00000100:00100000:1.0:1788587184.255970:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+27:12533:x1875469292101760:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788587184.256040:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256056:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256071:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256096:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256103:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256110:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256117:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587184.256121:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256147:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256171:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:1.0:1788587184.256174:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587184.256179:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.256186:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f63445a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587184.256253:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+27:12533:x1875469292101760:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 283us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587184.256261:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 201 00000100:00100000:0.0:1788587184.275652:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587184.276335:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292102016 00000100:00100000:3.0:1788587184.276356:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292102016 00000100:00100000:3.0:1788587184.276405:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:3.0:1788587184.276415:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+27:12533:x1875469292102016:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587184.276639:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+28:12533:x1875469292102016:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 223us (994us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788587184.276658:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:0.0:1788587184.328329:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.328413:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292102272 00000100:00100000:2.0:1788587184.328423:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292102272 00000100:00100000:2.0:1788587184.328482:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 202 00000100:00100000:2.0:1788587184.328493:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+28:12058:x1875469292102272:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587184.328518:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587184.328539:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445ac lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ac2 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.328634:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.328649:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 29 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.328676:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.328711:0:6474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 29 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.328724:0:6474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 29 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587184.328737:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309983232:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587184.328847:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587184.334065:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.334146:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309983232:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587184.334175:0:6474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587184.334287:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292102400 00000100:00100000:0.0:1788587184.334294:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292102400 00010000:00010000:0.0:1788587184.334337:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 30 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587184.334379:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:0.0:1788587184.334388:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+30:2409:x1875469292102400:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587184.334400:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587184.334407:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 30 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.334436:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 30 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.334458:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6344597 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5abb expref: 30 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.334483:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:0.0:1788587184.334487:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.334495:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.334501:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.334523:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587184.334570:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+29:2409:x1875469292102400:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 184us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587184.334577:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 91 00010000:00010000:2.0:1788587184.334779:0:6474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.334787:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587184.334832:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788587184.334974:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 30 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.334990:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 29 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.335010:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:2.0:1788587184.335013:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587184.335016:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062aea00, rc 0) 00000100:00100000:2.0:1788587184.335043:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+29:12058:x1875469292102272:12345-192.168.203.14@tcp:101:bash.0 Request processed in 6552us (6724us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788587184.335050:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 202 00000100:00100000:3.0:1788587184.337530:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587184.339242:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292102656 00000100:00100000:0.0:1788587184.339256:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292102656 00000100:00100000:0.0:1788587184.339306:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 203 00000100:00100000:0.0:1788587184.339316:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+29:12058:x1875469292102656:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:0.0:1788587184.339781:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.340215:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.340242:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587184.340300:0:6473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788587184.340447:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ea617bf reply state 00000000b5994719 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.340459:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.340532:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:0.0:1788587184.340535:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587184.340539:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788587184.340593:0:6473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788587184.340700:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+33:12058:x1875469292102656:12345-192.168.203.14@tcp:36:bash.0 Request processed in 1382us (3175us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788587184.340707:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 203 00000020:00080000:0.0:1788587184.340711:0:6473:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788587184.344325:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587184.344790:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292102784 00000100:00100000:3.0:1788587184.344833:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292102784 00000100:00100000:3.0:1788587184.344900:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 204 00000100:00100000:3.0:1788587184.344911:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+33:12058:x1875469292102784:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788587184.344932:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587184.344949:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63445c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ac9 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.345199:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63445c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac9 expref: 34 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.345220:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63445c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac9 expref: 34 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587184.345243:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:3.0:1788587184.345246:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587184.345250:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2400, rc 0) 00000100:00100000:3.0:1788587184.345310:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+34:12058:x1875469292102784:12345-192.168.203.14@tcp:101:bash.0 Request processed in 401us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587184.345317:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 204 00000100:00100000:3.0:1788587184.347335:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587184.347451:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292102912 00000100:00100000:0.0:1788587184.347460:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292102912 00000100:00100000:0.0:1788587184.347535:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:0.0:1788587184.347546:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+7:12058:x1875469292102912:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587184.347561:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587184.347578:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ad0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587184.347604:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bacac, atime: 0x6a9bacab, ctime: 0x6a9bacac, blocks: 0xb 00010000:00010000:0.0:1788587184.347624:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=382s v=(0 0) 00000100:00080000:3.0:1788587184.347634:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788587184.347642:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587184.347652:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.347671:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.347682:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105a00, rc 0) 00000100:00100000:0.0:1788587184.347735:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+8:12058:x1875469292102912:12345-192.168.203.14@tcp:101:bash.0 Request processed in 191us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587184.347742:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:0.0:1788587184.350263:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587184.350376:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292103040 00000100:00100000:1.0:1788587184.350384:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292103040 00002000:00010000:1.0:1788587184.350419:0:8106:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788587184.350424:0:8106:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe05c1a680 with x1875469292103040 ext(0->18446744073709551615) 00002000:00010000:1.0:1788587184.350435:0:8106:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe05c1a680. 00000100:00100000:1.0:1788587184.350477:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:1.0:1788587184.350487:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2409:x1875469292103040:12345-192.168.203.14@tcp:10:bash.0 00002000:00010000:1.0:1788587184.350750:0:8106:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788587184.350754:0:8106:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788587180 -> 1788587184 00002000:00010000:1.0:1788587184.350756:0:8106:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788587179 -> 1788587179 00002000:00010000:1.0:1788587184.350759:0:8106:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788587180 -> 1788587184 00002000:00010000:1.0:1788587184.350761:0:8106:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788587184.350855:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12266002-a8db-4050-aa6c-b9db12e6128d+9:2409:x1875469292103040:12345-192.168.203.14@tcp:10:bash.0 Request processed in 368us (598us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788587184.350881:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00002000:00010000:1.0:1788587184.350885:0:8106:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788587184.350887:0:8106:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe05c1a680 with x1875469292103040 ext(0->18446744073709551615) 00002000:00010000:1.0:1788587184.350892:0:8106:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe05c1a680. 00000100:00100000:1.0:1788587184.452448:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.454691:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292103168 00000100:00100000:2.0:1788587184.454708:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292103168 00000100:00100000:2.0:1788587184.454842:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 205 00000100:00100000:2.0:1788587184.454852:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+34:12547:x1875469292103168:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:2.0:1788587184.454994:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455012:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455025:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455040:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455047:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455054:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455490:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455500:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455508:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587184.455612:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455623:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455630:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455636:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455642:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587184.455645:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455652:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455664:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587184.455666:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587184.455671:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455684:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f63445d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455699:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455705:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455711:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455715:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587184.455949:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455957:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455966:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf03491700) 00010000:00010000:2.0:1788587184.455969:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587184.455972:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455979:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f63445dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.455999:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.456005:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.456016:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.456022:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587184.456025:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.456032:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.456039:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:2.0:1788587184.456042:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587184.456045:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.456051:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63445e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587184.456260:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+34:12547:x1875469292103168:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 1407us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587184.456270:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 205 00000100:00100000:3.0:1788587184.530612:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587184.530908:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292103424 00000100:00100000:0.0:1788587184.530920:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292103424 00000100:00100000:1.0:1788587184.535969:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 206 00000100:00100000:1.0:1788587184.535984:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+34:12550:x1875469292103424:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587184.536016:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587184.536038:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f63445eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ad7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536114:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536137:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536158:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536173:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536181:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536187:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536483:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344600 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536504:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536512:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587184.536521:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788587184.536618:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536625:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536631:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536637:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587184.536641:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536648:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536660:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587184.536663:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587184.536668:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536684:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f63445f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536699:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536706:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536711:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536716:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587184.536719:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536724:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536732:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:1.0:1788587184.536734:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587184.536737:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536743:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63445f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536781:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f63445eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad7 expref: 37 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536840:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344600 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad7 expref: 36 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.536855:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:1.0:1788587184.536858:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587184.536861:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e800, rc 0) 00000100:00100000:1.0:1788587184.536929:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+36:12550:x1875469292103424:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 948us (6326us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788587184.536937:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 206 00000100:00100000:0.0:1788587184.540769:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.557307:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292103552 00000100:00100000:2.0:1788587184.557324:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292103552 00000100:00100000:2.0:1788587184.559105:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 207 00000100:00100000:2.0:1788587184.559119:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+36:12550:x1875469292103552:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:2.0:1788587184.559206:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.559225:0:6472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 36 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.559249:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.559285:0:6472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 36 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.559300:0:6472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 36 pid: 6474 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587184.559314:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309983360:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587184.559911:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788587184.560235:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587184.568100:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587184.568182:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292103808 00000100:00100000:3.0:1788587184.568203:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292103808 00000100:00100000:3.0:1788587184.568292:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788587184.568303:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+37:6380:x1875469292103808:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788587184.569208:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+38:6380:x1875469292103808:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 904us (1113us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788587184.569217:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:2.0:1788587184.569838:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309983360:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587184.569862:0:6472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587184.574205:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587184.574766:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292103936 00000100:00100000:1.0:1788587184.574776:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292103936 00010000:00010000:0.0:1788587184.575067:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 38 pid: 6474 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587184.575148:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 92 00000100:00100000:0.0:1788587184.575159:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+38:2409:x1875469292103936:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587184.575174:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587184.575181:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 38 pid: 6474 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.575194:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 38 pid: 6474 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.575224:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aea00/0x419e1ae1f63445b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac2 expref: 38 pid: 6474 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.575239:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:0.0:1788587184.575244:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.575253:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.575261:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.575293:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587184.575468:0:6472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.575477:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.575517:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.575524:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.575551:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.575557:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587184.575561:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.575568:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.575576:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:2.0:1788587184.575579:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587184.575583:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.575588:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f634460e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587184.575645:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+37:2409:x1875469292103936:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 487us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587184.575653:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 92 00000100:00100000:2.0:1788587184.576202:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+36:12550:x1875469292103552:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 17085us (35441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587184.576211:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 207 00000100:00100000:3.0:1788587184.579201:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.579260:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292104192 00000100:00100000:2.0:1788587184.579269:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292104192 00000100:00100000:2.0:1788587184.579319:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:2.0:1788587184.579329:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+36:12550:x1875469292104192:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788587184.580640:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+37:12550:x1875469292104192:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 1306us (1440us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788587184.580650:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:3.0:1788587184.733673:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.734732:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292104448 00000100:00100000:2.0:1788587184.734744:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292104448 00000100:00100000:2.0:1788587184.734852:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 208 00000100:00100000:2.0:1788587184.734863:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+37:12561:x1875469292104448:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:2.0:1788587184.734897:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587184.734917:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344615 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ade expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.734997:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.735549:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.735562:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.735581:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.735588:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.735595:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.736696:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634462a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.736708:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634462a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737098:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634462a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587184.737110:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788587184.737213:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737221:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737228:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737234:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587184.737238:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737245:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737257:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587184.737260:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587184.737266:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737272:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f634461c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737285:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737290:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737303:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737307:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587184.737310:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737316:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.737323:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf03491700) 00010000:00010000:2.0:1788587184.737326:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587184.737329:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.738417:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f6344623 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.738483:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ade expref: 40 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.738496:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634462a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ade expref: 39 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.738504:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:2.0:1788587184.738506:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587184.738509:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062af400, rc 0) 00000100:00100000:2.0:1788587184.738590:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+39:12561:x1875469292104448:12345-192.168.203.14@tcp:101:cat.0 Request processed in 3728us (4924us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788587184.738611:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 208 00000100:00100000:1.0:1788587184.753186:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587184.753979:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292104704 00000100:00100000:3.0:1788587184.753990:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292104704 00000100:00100000:3.0:1788587184.754055:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:3.0:1788587184.754065:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+39:12561:x1875469292104704:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:3.0:1788587184.754313:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+40:12561:x1875469292104704:12345-192.168.203.14@tcp:35:cat.0 Request processed in 248us (1135us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788587184.754320:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:0.0:1788587184.810151:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587184.810471:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292104960 00000100:00100000:1.0:1788587184.810482:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292104960 00000100:00100000:1.0:1788587184.810550:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 209 00000100:00100000:1.0:1788587184.810562:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+40:12563:x1875469292104960:12345-192.168.203.14@tcp:36:rm.0 00010000:00010000:1.0:1788587184.810618:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788587184.810644:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af400/0x419e1ae1f634462a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ade expref: 40 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.810666:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344600 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad7 expref: 39 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.810680:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2400/0x419e1ae1f63445c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ac9 expref: 38 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.810701:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:1.0:1788587184.810707:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587184.810741:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.811187:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.811199:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.811215:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.811222:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.811228:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.811469:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.811479:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.811486:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587184.815624:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788587184.815643:0:6473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382564848013ns, next at 383564844428ns, rc = 0 00010000:00010000:1.0:1788587184.816097:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816115:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816151:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816160:0:6473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816167:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816173:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816196:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587184.816218:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816225:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816230:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816236:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587184.816239:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816247:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816259:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:1.0:1788587184.816262:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788587184.816274:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816281:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f6344646 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816302:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816308:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816314:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816319:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587184.816321:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816327:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816334:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587184.816337:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587184.816340:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.816346:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e200/0x419e1ae1f6344638 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.817155:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587184.817164:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.817172:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ea00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587184.817175:0:8116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.817182:0:8116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.817192:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:2.0:1788587184.817194:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587184.817197:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.817202:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ea00/0x419e1ae1f634464d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.817216:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587184.817217:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587184.817219:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1788587184.817626:0:6473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2df7388 reply state 000000009e398f43 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.817655:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.817662:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:1.0:1788587184.817665:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587184.817668:0:6473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587184.820327:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+39:12563:x1875469292104960:12345-192.168.203.14@tcp:36:rm.0 Request processed in 9119us (9536us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788587184.820342:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 209 00000100:00100000:1.0:1788587184.881152:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.881258:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292105216 00000100:00100000:2.0:1788587184.881268:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292105216 00000100:00100000:2.0:1788587184.881342:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 210 00000100:00100000:2.0:1788587184.881354:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+39:12569:x1875469292105216:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587184.881378:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587184.881397:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344654 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ae5 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.881760:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.881774:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.881833:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.881845:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.881854:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.881860:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587184.882407:0:6472:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788587184.884770:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.885241:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.885257:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.885300:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.885323:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.885330:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.886677:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587184.886685:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.886696:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.886713:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587184.886715:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587184.886721:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.886729:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af000/0x419e1ae1f634465b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587184.886747:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000facabe19 reply state 000000005aeaac2c transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.886758:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.886765:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:2.0:1788587184.886768:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587184.886771:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788587184.887198:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344654 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 42 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.887230:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 41 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.887238:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf03491700) 00010000:00010000:2.0:1788587184.887241:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587184.887244:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae200, rc 0) 00000100:00100000:2.0:1788587184.887318:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+42:12569:x1875469292105216:12345-192.168.203.14@tcp:101:bash.0 Request processed in 5965us (6175us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788587184.887327:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 210 00000100:00100000:0.0:1788587184.892365:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.892441:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292105344 00000100:00100000:2.0:1788587184.892451:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292105344 00000100:00100000:2.0:1788587184.892536:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:2.0:1788587184.892547:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292105344:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587184.892563:0:8099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587184.892581:0:8099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5aec expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587184.892607:0:8099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587184.892636:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1788587184.892641:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587184.892651:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 6 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.892671:0:8099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 6 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.892706:0:8099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae800, rc 0) 00000100:00100000:2.0:1788587184.892765:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2411:x1875469292105344:12345-192.168.203.14@tcp:101:bash.0 Request processed in 221us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587184.892773:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00080000:3.0:1788587184.894021:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587184.903724:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587184.905557:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292105472 00000100:00100000:2.0:1788587184.905572:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292105472 00000100:00100000:2.0:1788587184.905649:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:2.0:1788587184.905660:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf367df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+6:12569:x1875469292105472:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587184.905677:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587184.905695:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5af3 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.905729:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 7 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.905739:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587184.905744:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587184.905749:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.905783:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 7 pid: 8099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587184.905831:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 7 pid: 8099 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587184.905859:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8449:1875469309983488:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587184.905952:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587184.912253:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587184.912354:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292105600 00000100:00100000:1.0:1788587184.912364:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292105600 00010000:00010000:1.0:1788587184.912408:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 8 pid: 8099 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587184.912451:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:1.0:1788587184.912461:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292105600:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587184.912475:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587184.912505:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 8 pid: 8099 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.912519:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 8 pid: 8099 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.912723:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587184.912728:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587184.912750:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587184.912762:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.913186:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000571dd8f3/0x419e1ae1f6344677 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5aec expref: 8 pid: 8099 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587184.913202:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8449:1875469309983488:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587184.913228:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587184.913252:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062aee00, rc 0) 00000100:00100000:0.0:1788587184.913303:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf367df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+7:12569:x1875469292105472:12345-192.168.203.14@tcp:101:bash.0 Request processed in 7644us (9589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587184.913315:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00010000:00010000:3.0:1788587184.919697:0:6458:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587184.919726:0:6458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6458:1875469309983616:192.168.203.14@tcp:105: 00000100:00100000:3.0:1788587184.921062:0:6458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587184.931785:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587184.935782:0:6458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6458:1875469309983616:192.168.203.14@tcp:105: 00010000:00010000:3.0:1788587184.935888:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587184.937352:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292105856 00000100:00100000:0.0:1788587184.937362:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292105856 00000100:00100000:0.0:1788587184.937430:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:0.0:1788587184.937440:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+42:12569:x1875469292105856:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:0.0:1788587184.938135:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+43:12569:x1875469292105856:12345-192.168.203.14@tcp:35:bash.0 Request processed in 682us (6345us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788587184.938145:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:2.0:1788587184.942161:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+6:2410:x1875469292105600:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 29689us (29906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587184.942176:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:2.0:1788587185.107203:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587185.107268:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292105984 00000100:00100000:0.0:1788587185.107279:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292105984 00000100:00100000:0.0:1788587185.107373:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 211 00000100:00100000:0.0:1788587185.107395:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+43:12585:x1875469292105984:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587185.107418:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587185.107439:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5afa expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.107499:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f634468c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.107513:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f634468c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.107524:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f634468c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587185.107566:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788587185.107570:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587185.107586:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f634468c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.107610:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f6344685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5afa expref: 45 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.107628:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f634468c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5afa expref: 44 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.107636:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:0.0:1788587185.107640:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587185.107643:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105200, rc 0) 00000100:00100000:0.0:1788587185.107703:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+44:12585:x1875469292105984:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 320us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.107709:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 211 00000100:00100000:0.0:1788587185.113830:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587185.114079:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292106240 00000100:00100000:1.0:1788587185.114088:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292106240 00000100:00100000:1.0:1788587185.114150:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 212 00000100:00100000:1.0:1788587185.114161:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+44:12585:x1875469292106240:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587185.114181:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587185.114200:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344693 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b01 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.114293:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f634469a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.114308:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f634469a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.114320:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f634469a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587185.114331:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788587185.114456:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344693 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b01 expref: 47 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.114474:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f634469a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b01 expref: 46 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.114516:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf03491700) 00010000:00010000:1.0:1788587185.114519:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587185.114523:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fc00, rc 0) 00000100:00100000:1.0:1788587185.114574:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+46:12585:x1875469292106240:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 415us (782us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788587185.114581:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 212 00000100:00100000:1.0:1788587185.117287:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587185.117342:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587185.117655:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292106624 00000100:00100000:0.0:1788587185.117665:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292106624 00000100:00100000:0.0:1788587185.117732:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:0.0:1788587185.117742:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+46:2410:x1875469292106624:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587185.117755:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587185.117777:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fc00/0x419e1ae1f634469a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b01 expref: 46 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.117825:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf03491700) 00010000:00010000:0.0:1788587185.117841:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587185.117882:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+45:2410:x1875469292106624:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 141us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.117890:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:2.0:1788587185.118285:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292106496 00000100:00100000:2.0:1788587185.118290:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292106496 00000100:00100000:2.0:1788587185.118326:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 213 00000100:00100000:2.0:1788587185.118333:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+45:12585:x1875469292106496:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587185.118361:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587185.118375:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b08 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.118452:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.118465:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.118475:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587185.118485:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788587185.118894:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b08 expref: 48 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.118911:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b08 expref: 47 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.118918:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf03491700) 00010000:00010000:2.0:1788587185.118921:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587185.118924:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae600, rc 0) 00000100:00100000:2.0:1788587185.118998:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+47:12585:x1875469292106496:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 664us (1718us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788587185.119012:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 213 00000100:00100000:1.0:1788587185.125693:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.125974:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292106752 00000100:00100000:2.0:1788587185.125984:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292106752 00000100:00100000:2.0:1788587185.126135:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:2.0:1788587185.126146:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+6:2409:x1875469292106752:12345-192.168.203.14@tcp:1:lfs.0 00010000:00010000:2.0:1788587185.126186:0:8099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.126205:0:8099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.126214:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587185.126218:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587185.126223:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.126255:0:8099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.126281:0:8099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 6 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.126296:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8099:1875469309983744:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587185.126386:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf081146c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587185.132962:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.133270:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8099:1875469309983744:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587185.133298:0:8099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587185.133731:0:8107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292106880 00000100:00100000:1.0:1788587185.133739:0:8107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292106880 00002000:00100000:1.0:1788587185.133784:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8cbf36f2aa00 x1875469292106880/t0(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:501/0 lens 504/0 e 0 to 0 dl 1788587196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587185.133826:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf36f2aa00 with x1875469292106880 ext(0->8) 00010000:00010000:1.0:1788587185.133835:0:8107:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 7 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.133851:0:8107:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 7 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587185.133859:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbf36f2aa00 00000100:00100000:1.0:1788587185.133888:0:8107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587185.133898:0:8107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292106880:12345-192.168.203.14@tcp:4:lfs.0 00000100:00100000:1.0:1788587185.134415:0:8107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+9:2409:x1875469292106880:12345-192.168.203.14@tcp:4:lfs.0 Request processed in 516us (1459us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788587185.134427:0:8107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00002000:00100000:1.0:1788587185.134435:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8cbf36f2aa00 x1875469292106880/t4294967309(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:501/0 lens 504/448 e 0 to 0 dl 1788587196 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587185.134443:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbf36f2aa00 with x1875469292106880 ext(0->8) 00010000:00010000:1.0:1788587185.134450:0:8107:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 9 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.134463:0:8107:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 9 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587185.134470:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbf36f2aa00 00000100:00100000:3.0:1788587185.137473:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.137838:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292107008 00000100:00100000:2.0:1788587185.137847:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292107008 00010000:00010000:2.0:1788587185.137886:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 9 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.137928:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00100000:2.0:1788587185.137937:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf06301450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+9:2410:x1875469292107008:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587185.137950:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788587185.137966:0:6458:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788587185.137969:0:6458:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788587184 00002000:00010000:2.0:1788587185.137971:0:6458:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788587184 00002000:00010000:2.0:1788587185.137974:0:6458:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788587184 00010000:00010000:2.0:1788587185.137979:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 9 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.138020:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 9 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.138043:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb4f6aff/0x419e1ae1f634467e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5af3 expref: 9 pid: 8449 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.138059:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587185.138063:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587185.138069:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.138080:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.138114:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587185.138169:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf06301450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292107008:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 233us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.138176:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 94 00010000:00010000:1.0:1788587185.138584:0:8099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.138596:0:8099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.138622:0:8099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.138631:0:8099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.138640:0:8099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.138659:0:8099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587185.138664:0:8099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.138673:0:8099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.138686:0:8099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.138694:0:8099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d99c839/0x419e1ae1f63446bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587185.138743:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292106752:12345-192.168.203.14@tcp:1:lfs.0 Request processed in 12598us (13057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587185.138751:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:0.0:1788587185.150298:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.150541:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292107264 00000100:00100000:2.0:1788587185.150550:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292107264 00000100:00100000:2.0:1788587185.150605:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:2.0:1788587185.150614:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+47:12585:x1875469292107264:12345-192.168.203.14@tcp:35:lfs.0 00000004:00010000:2.0:1788587185.150671:0:14171:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b08 expref: 47 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587185.151068:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788587185.151107:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788587185.151568:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788587185.151619:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.151634:0:14171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 51 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.151643:0:14171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.151676:0:14171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 51 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.151692:0:14171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 51 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.151706:0:14171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14171:1875469309983872:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587185.152087:0:14171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587185.157496:0:14171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14171:1875469309983872:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587185.157534:0:14171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587185.168835:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.169054:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292107392 00000100:00100000:2.0:1788587185.169063:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292107392 00010000:00010000:2.0:1788587185.169103:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 52 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.169169:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 95 00000100:00100000:2.0:1788587185.169178:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+52:2410:x1875469292107392:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587185.169197:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587185.169204:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 52 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.169217:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 52 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.169237:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344669 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ae5 expref: 52 pid: 6472 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.169253:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf03491700) 00010000:00010000:2.0:1788587185.169258:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.169267:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.169274:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.169306:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587185.169366:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+51:2410:x1875469292107392:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 189us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.169374:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 95 00010000:00010000:3.0:1788587185.169625:0:14171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587185.169641:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587185.169772:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788587185.169978:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788587185.170068:0:14171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f29180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14171:1875469309984000:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788587185.170115:0:14171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587185.170608:0:14171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587185.171677:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309984000 00000100:00100000:1.0:1788587185.171688:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309984000 00000100:00100000:1.0:1788587185.171759:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788587185.171769:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14171:x1875469309984000:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788587185.171867:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14171:x1875469309984000:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 100us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587185.171874:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788587185.171997:0:14171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f29180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14171:1875469309984000:0@lo:1000:mdt_rdpg00_002.0 00000100:00080000:3.0:1788587185.172582:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788587185.172740:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788587185.172828:0:14171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14171:1875469309984128:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788587185.172877:0:14171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587185.174285:0:14171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf081143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587185.174366:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309984128 00000100:00100000:1.0:1788587185.174483:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309984128 00000100:00100000:1.0:1788587185.174531:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788587185.174539:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14171:x1875469309984128:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788587185.174733:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14171:x1875469309984128:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 195us (1855us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788587185.174740:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788587185.174982:0:14171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14171:1875469309984128:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788587185.175046:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788587185.175099:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.175110:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.175516:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.175524:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.175529:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.175538:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.175552:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf03491700) 00010000:00010000:2.0:1788587185.175555:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788587185.175559:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.175566:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587185.175860:0:14171:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788587185.175950:0:14171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788587185.175960:0:14171:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382925164921ns, next at 383925163231ns, rc = 0 00000001:00080000:2.0:1788587185.175965:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788587185.175993:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf03491700) 00010000:00010000:2.0:1788587185.176007:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587185.176013:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446af lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b08 expref: 55 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.176708:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+54:12585:x1875469292107264:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 26092us (26417us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788587185.176717:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000020:00080000:2.0:1788587185.176722:0:14171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788587185.182496:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587185.182689:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292107520 00000100:00100000:0.0:1788587185.182700:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292107520 00000100:00100000:0.0:1788587185.182765:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 214 00000100:00100000:0.0:1788587185.182774:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+54:12585:x1875469292107520:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587185.182909:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587185.182932:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63446cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b0f expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.182989:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63446cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b0f expref: 55 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.183065:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63446cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b0f expref: 55 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.183087:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587185.183090:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587185.183094:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105000, rc 0) 00000100:00100000:0.0:1788587185.183195:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+55:12585:x1875469292107520:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 420us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.183201:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 214 00000100:00100000:3.0:1788587185.188654:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587185.188735:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292107776 00000100:00100000:1.0:1788587185.188745:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292107776 00000100:00100000:1.0:1788587185.188820:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:1.0:1788587185.188830:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf18716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+55:12585:x1875469292107776:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788587185.189353:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf18716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+56:12585:x1875469292107776:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 522us (707us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788587185.189362:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:0.0:1788587185.195150:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309984640:0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.195173:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309984384:0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.195221:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587185.195276:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309985152:0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.195298:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309984640 00000100:00100000:0.0:1788587185.195304:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587185.195308:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309984640 00000100:00100000:0.0:1788587185.195322:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309985664:0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.195361:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788587185.195370:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309984640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.195415:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309984640:12345-0@lo:400:kworker.0 Request processed in 46us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.195425:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788587185.195426:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309984256:0@lo:400:kworker.0 00000100:00100000:1.0:1788587185.195464:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587185.195495:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309984768:0@lo:400:kworker.0 00000100:00100000:1.0:1788587185.195525:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587185.195542:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309985280:0@lo:400:kworker.0 00000100:00100000:1.0:1788587185.195560:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587185.195568:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309984256 00000100:00100000:2.0:1788587185.195573:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309984256 00000100:00100000:1.0:1788587185.195596:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309984768 00000100:00100000:1.0:1788587185.195601:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309984768 00000100:00100000:2.0:1788587185.195613:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788587185.195622:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309984256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587185.195634:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788587185.195643:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309984768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.195661:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309984256:12345-0@lo:400:kworker.0 Request processed in 40us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.195668:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788587185.195689:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309984768:12345-0@lo:400:kworker.0 Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587185.195705:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788587185.195755:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309984256:0@lo:400:kworker.0 00000100:00100000:1.0:1788587185.195766:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309984768:0@lo:400:kworker.0 00000100:00100000:3.0:1788587185.195977:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309984512:0@lo:400:kworker.0 00000100:00100000:3.0:1788587185.196014:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587185.196036:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309985024:0@lo:400:kworker.0 00000100:00100000:3.0:1788587185.196055:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587185.196073:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309985536:0@lo:400:kworker.0 00000100:00100000:3.0:1788587185.196089:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587185.196268:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309984512 00000100:00100000:1.0:1788587185.196273:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309984512 00000100:00100000:1.0:1788587185.196291:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788587185.196297:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309984512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.196323:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309985024 00000100:00100000:2.0:1788587185.196328:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309985024 00000100:00100000:2.0:1788587185.196367:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309985536 00000100:00100000:2.0:1788587185.196370:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309985536 00000100:00100000:2.0:1788587185.196394:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788587185.196401:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309985024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.196429:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469309985024:12345-0@lo:400:kworker.0 Request processed in 29us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.196435:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788587185.196446:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788587185.196451:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309985536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.196470:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469309985536:12345-0@lo:400:kworker.0 Request processed in 20us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.196476:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:3.0:1788587185.196600:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587185.196869:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309984512:12345-0@lo:400:kworker.0 Request processed in 38us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587185.196878:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788587185.196911:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309984512:0@lo:400:kworker.0 00010000:00080000:1.0:1788587185.196923:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03d9ca80 x1875469309985024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587185.196932:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469309985024:0@lo:400:kworker.0 00010000:00080000:1.0:1788587185.196940:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03d9ed80 x1875469309985536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587185.196949:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469309985536:0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.197438:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587185.197480:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309984640:0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.197573:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309985152 00000100:00100000:0.0:1788587185.197578:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309985152 00000100:00100000:0.0:1788587185.197660:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309985280 00000100:00100000:0.0:1788587185.197664:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309985280 00000100:00100000:2.0:1788587185.198537:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309985664 00000100:00100000:2.0:1788587185.198543:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309985664 00000100:00080000:3.0:1788587185.198560:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587185.198566:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587185.198574:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788587185.198583:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309985152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.198653:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309985152:12345-0@lo:400:kworker.0 Request processed in 71us (3351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.198660:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788587185.198680:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788587185.198688:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309985280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.198706:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788587185.198718:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309985664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.198738:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3472:x1875469309985280:12345-0@lo:400:kworker.0 Request processed in 50us (3176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.198745:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788587185.198760:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309985664:12345-0@lo:400:kworker.0 Request processed in 46us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.198767:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788587185.198790:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587185.198827:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309984896:0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.198854:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587185.198869:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309985408:0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.198890:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309984384 00000100:00100000:0.0:1788587185.198901:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587185.198925:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309984384 00000100:00100000:0.0:1788587185.198934:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309984896 00000100:00100000:0.0:1788587185.198939:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309984896 00000100:00100000:2.0:1788587185.198956:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309985408 00000100:00100000:2.0:1788587185.198961:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309985408 00000100:00100000:0.0:1788587185.198967:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788587185.198976:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309984384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.198986:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788587185.198995:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309984896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.199037:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309984896:12345-0@lo:400:kworker.0 Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.199043:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788587185.199054:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788587185.199059:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309985408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587185.199081:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309985408:12345-0@lo:400:kworker.0 Request processed in 23us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.199087:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788587185.199164:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309984384:12345-0@lo:400:kworker.0 Request processed in 189us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.199171:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:3.0:1788587185.199181:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587185.199213:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309985152:0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.199220:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309984384:0@lo:400:kworker.0 00000100:00100000:3.0:1788587185.199232:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309985664:0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.199238:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309984896:0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.199407:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309985408:0@lo:400:kworker.0 00000100:00100000:0.0:1788587185.199466:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309985280:0@lo:400:kworker.0 00000100:00100000:3.0:1788587185.250562:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.250774:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292107904 00000100:00100000:2.0:1788587185.250784:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292107904 00000100:00100000:2.0:1788587185.250869:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 215 00000100:00100000:2.0:1788587185.250879:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+56:12595:x1875469292107904:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:2.0:1788587185.250948:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.250965:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.250975:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.250986:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251009:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251016:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251163:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251172:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251179:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587185.251214:0:6472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251225:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251232:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251239:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251245:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.251249:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251256:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251273:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587185.251276:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587185.251280:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251287:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251299:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251306:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251311:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251316:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.251319:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251325:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251331:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:2.0:1788587185.251333:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587185.251336:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251342:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251358:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251365:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251370:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251771:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.251774:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251782:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251790:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.251827:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587185.251831:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.251838:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.251910:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+56:12595:x1875469292107904:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 1032us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.251917:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 215 00000100:00100000:0.0:1788587185.276541:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.276714:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292108160 00000100:00100000:2.0:1788587185.276768:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292108160 00000100:00100000:2.0:1788587185.276849:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 216 00000100:00100000:2.0:1788587185.276872:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+56:12598:x1875469292108160:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587185.276949:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587185.276968:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b16 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277028:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277041:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277053:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277062:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277070:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277076:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277246:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277255:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277262:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587185.277282:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788587185.277364:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277382:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277390:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277396:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.277400:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277411:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277422:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587185.277425:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587185.277430:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277437:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f63446ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277449:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277455:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277470:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277475:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.277478:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277485:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277491:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:2.0:1788587185.277493:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587185.277496:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277502:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f63446f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277532:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63446e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 59 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277543:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 58 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.277551:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.277553:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587185.277556:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062af800, rc 0) 00000100:00100000:2.0:1788587185.277618:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+58:12598:x1875469292108160:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 748us (1086us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788587185.277634:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 216 00000100:00100000:1.0:1788587185.279660:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.279740:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292108288 00000100:00100000:2.0:1788587185.279749:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292108288 00000100:00100000:2.0:1788587185.279818:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 217 00000100:00100000:2.0:1788587185.279827:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+58:12598:x1875469292108288:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:2.0:1788587185.279881:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279897:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279908:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279928:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279936:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279943:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279948:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.279953:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279960:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279970:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.279981:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587185.279987:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.279994:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634470a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.280055:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+58:12598:x1875469292108288:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 229us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.280063:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 217 00000100:00100000:3.0:1788587185.281334:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.281385:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292108544 00000100:00100000:2.0:1788587185.281392:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292108544 00000100:00100000:2.0:1788587185.281436:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:2.0:1788587185.281443:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+58:12598:x1875469292108544:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788587185.281620:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+59:12598:x1875469292108544:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 176us (290us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788587185.281627:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:0.0:1788587185.335926:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.336100:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292108800 00000100:00100000:2.0:1788587185.336110:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292108800 00000100:00100000:2.0:1788587185.336180:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 218 00000100:00100000:2.0:1788587185.336191:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+59:12608:x1875469292108800:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587185.336215:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587185.336218:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788587185.336243:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f634468c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5afa expref: 59 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.336263:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587185.336269:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587185.336296:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344711 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b1d expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.336393:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.336409:0:6472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 59 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.336418:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.336461:0:6472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 59 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.336475:0:6472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 59 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.336489:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309985792:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587185.336581:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf348336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587185.339720:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309985792:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587185.339748:0:6472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587185.341028:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.341184:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292108928 00000100:00100000:2.0:1788587185.341193:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292108928 00010000:00010000:2.0:1788587185.341230:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 60 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.341290:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:2.0:1788587185.341299:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+60:2409:x1875469292108928:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587185.341314:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587185.341320:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 60 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.341332:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 60 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.341353:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f63446fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b16 expref: 60 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.341367:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.341486:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.341497:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.341506:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.341533:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587185.341640:0:6472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.341649:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587185.341675:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788587185.341836:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344711 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 61 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.341852:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 60 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.341859:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:1.0:1788587185.341862:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587185.341865:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae200, rc 0) 00000100:00100000:2.0:1788587185.341929:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+60:2409:x1875469292108928:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 629us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.341937:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:1.0:1788587185.345246:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+59:12608:x1875469292108800:12345-192.168.203.14@tcp:101:bash.0 Request processed in 9046us (9316us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788587185.345258:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 218 00000100:00100000:1.0:1788587185.348874:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.349001:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292109184 00000100:00100000:2.0:1788587185.349024:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292109184 00000100:00100000:2.0:1788587185.349383:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 219 00000100:00100000:2.0:1788587185.349393:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+59:12608:x1875469292109184:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:2.0:1788587185.349630:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.349657:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.349668:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587185.349715:0:6474:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1788587185.349754:0:6474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090a1b4b8 reply state 00000000ed1d6c49 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.349766:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.349774:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.349777:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587185.349780:0:6474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587185.353744:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+62:12608:x1875469292109184:12345-192.168.203.14@tcp:36:bash.0 Request processed in 4342us (4867us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788587185.353757:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 219 00000020:00080000:2.0:1788587185.353765:0:6474:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788587185.356751:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587185.356879:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292109312 00000100:00100000:0.0:1788587185.356888:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292109312 00000100:00100000:0.0:1788587185.356934:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 220 00000100:00100000:0.0:1788587185.357050:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+62:12608:x1875469292109312:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587185.357073:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587185.357094:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f634472d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b24 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.357180:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.357193:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 63 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.357202:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.357234:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 63 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.357269:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 63 pid: 6472 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587185.357282:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309985920:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587185.357487:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587185.360302:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587185.360515:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292109440 00000100:00100000:1.0:1788587185.360524:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292109440 00010000:00010000:1.0:1788587185.360561:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 64 pid: 6472 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587185.360600:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 97 00000100:00100000:1.0:1788587185.360609:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+64:2410:x1875469292109440:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587185.360622:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587185.360628:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 64 pid: 6472 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.360641:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 64 pid: 6472 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.360677:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:1.0:1788587185.360683:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587185.360686:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344718 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b1d expref: 64 pid: 6472 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.360694:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.360714:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.360733:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587185.360776:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309985920:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788587185.360831:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587185.360842:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587185.360850:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+63:2410:x1875469292109440:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 239us (554us total) trans 0 rc 0/0 00010000:00010000:3.0:1788587185.360851:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587185.360865:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 97 00000004:00200000:3.0:1788587185.360898:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788587185.360903:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587185.360921:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587185.360962:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37104800/0x419e1ae1f634472d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 63 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587185.360976:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 62 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587185.360983:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:3.0:1788587185.360986:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587185.360988:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf37105200, rc 0) 00000100:00100000:0.0:1788587185.361513:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+62:12608:x1875469292109312:12345-192.168.203.14@tcp:101:bash.0 Request processed in 4568us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.361521:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 220 00000100:00100000:0.0:1788587185.363727:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587185.363889:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292109696 00000100:00100000:1.0:1788587185.363898:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292109696 00000100:00100000:1.0:1788587185.363946:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:1.0:1788587185.363956:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+62:12608:x1875469292109696:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:1.0:1788587185.364263:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+63:12608:x1875469292109696:12345-192.168.203.14@tcp:35:bash.0 Request processed in 308us (553us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788587185.364271:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:0.0:1788587185.437975:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587185.438070:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292109824 00000100:00100000:1.0:1788587185.438080:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292109824 00000100:00100000:1.0:1788587185.438199:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 221 00000100:00100000:1.0:1788587185.438208:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+63:12614:x1875469292109824:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587185.438230:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587185.438261:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f634473b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b2b expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.439356:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344742 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.439374:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.439388:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587185.439423:0:6472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788587185.439426:0:6472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587185.439444:0:6472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.439470:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f634473b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b2b expref: 65 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.439488:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344742 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b2b expref: 64 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.439497:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587185.439499:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587185.439503:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fe00, rc 0) 00000100:00100000:1.0:1788587185.439556:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+64:12614:x1875469292109824:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1348us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587185.439564:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 221 00000100:00100000:0.0:1788587185.444695:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.444782:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292109952 00000100:00100000:2.0:1788587185.444791:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292109952 00000100:00100000:2.0:1788587185.444860:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 222 00000100:00100000:2.0:1788587185.444869:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+64:12614:x1875469292109952:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587185.444901:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587185.444922:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6344749 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b32 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.444981:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.444995:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445007:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445018:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445025:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445031:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445304:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445314:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445322:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587185.445426:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788587185.445436:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587185.445468:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445481:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445490:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445561:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445571:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445577:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.445581:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445589:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445601:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:2.0:1788587185.445604:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587185.445609:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445615:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062aee00/0x419e1ae1f6344750 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445628:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445644:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445650:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445655:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587185.445658:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445665:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445673:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:2.0:1788587185.445676:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587185.445679:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445685:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344757 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445719:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f6344749 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 66 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445735:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 65 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.445741:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.445743:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587185.445752:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062af600, rc 0) 00000100:00100000:2.0:1788587185.446045:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+65:12614:x1875469292109952:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1175us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.446054:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 222 00000100:00100000:0.0:1788587185.461431:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587185.463827:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587185.464358:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292110336 00000100:00100000:0.0:1788587185.464368:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292110336 00000100:00100000:0.0:1788587185.464428:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 223 00000100:00100000:0.0:1788587185.464438:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+65:12614:x1875469292110336:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587185.464466:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587185.464489:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344765 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b39 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.464750:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.464766:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 66 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.464787:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 66 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.464821:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.464849:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 66 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.464859:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 66 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587185.464868:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309986048:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587185.464928:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 66 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.464934:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 66 pid: 8126 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587185.464939:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309986176:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587185.464951:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587185.465658:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292110080 00000100:00100000:2.0:1788587185.465665:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292110080 00010000:00010000:2.0:1788587185.465693:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 67 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.465726:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 98 00000100:00100000:2.0:1788587185.465734:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+67:2409:x1875469292110080:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587185.465744:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587185.465750:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 67 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.465761:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 67 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.465777:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.465782:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.465789:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.465820:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587185.465851:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+67:2409:x1875469292110080:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 118us (4430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.465858:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 98 00010000:00010000:2.0:1788587185.467743:0:8126:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.14@tcp) returned -22 from blocking AST (req@00000000cac99730 x1875469309986048) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 66 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.467764:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f634475e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b32 expref: 66 pid: 6474 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.467778:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309986048:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587185.467840:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8126:1875469309986176:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587185.467859:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.467864:0:8126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.467872:0:8126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.467881:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587185.469056:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587185.469609:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292110464 00000100:00100000:2.0:1788587185.469617:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292110464 00010000:00010000:2.0:1788587185.469656:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 66 pid: 8126 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587185.469694:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 99 00000100:00100000:2.0:1788587185.469705:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+66:2410:x1875469292110464:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587185.469721:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587185.469728:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 66 pid: 8126 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.469754:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 66 pid: 8126 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.469776:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105200/0x419e1ae1f6344734 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b24 expref: 66 pid: 8126 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.469789:0:6459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587185.469813:0:6459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.469822:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.469829:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587185.469863:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587185.469915:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+65:2410:x1875469292110464:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 211us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587185.469922:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 99 00010000:00010000:0.0:1788587185.470738:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.470748:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587185.470780:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788587185.470948:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f6344765 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 66 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.470963:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 65 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.470970:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587185.470973:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587185.470975:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483400, rc 0) 00000100:00100000:0.0:1788587185.471021:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+65:12614:x1875469292110336:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 6584us (7199us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788587185.471029:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 223 00000100:00100000:3.0:1788587185.477443:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587185.477703:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292110720 00000100:00100000:1.0:1788587185.477714:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292110720 00000100:00100000:1.0:1788587185.477862:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:1.0:1788587185.477874:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+65:12614:x1875469292110720:12345-192.168.203.14@tcp:103:lfs.0 00010000:00010000:1.0:1788587185.477889:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587185.477912:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105000/0x419e1ae1f63446cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b0f expref: 65 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587185.477930:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:1.0:1788587185.477935:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587185.477992:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+64:12614:x1875469292110720:12345-192.168.203.14@tcp:103:lfs.0 Request processed in 121us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587185.477999:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788587185.481102:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587185.481589:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292110848 00000100:00100000:0.0:1788587185.481598:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292110848 00000100:00100000:0.0:1788587185.481655:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 224 00000100:00100000:0.0:1788587185.481666:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+64:12614:x1875469292110848:12345-192.168.203.14@tcp:58:lfs.0 00010000:00010000:0.0:1788587185.481766:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.481782:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.481810:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587185.482072:0:6472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788587185.482165:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+64:12614:x1875469292110848:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 501us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.482173:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 224 00000100:00100000:3.0:1788587185.484106:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587185.484382:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292110976 00000100:00100000:0.0:1788587185.484390:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292110976 00000100:00100000:0.0:1788587185.484449:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 225 00000100:00100000:0.0:1788587185.484467:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe057c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+64:12614:x1875469292110976:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587185.484483:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587185.484509:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b40 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.484561:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.484572:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b40 expref: 65 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.484590:0:6474:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.484601:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b40 expref: 65 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.484613:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587185.484616:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587185.484620:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b40 expref: 65 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587185.484627:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482c00, rc 0) 00000100:00100000:0.0:1788587185.484676:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe057c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+65:12614:x1875469292110976:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 219us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.484683:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 225 00010000:00010000:3.0:1788587185.579040:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587185.707389:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309986304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587185.707452:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587185.708074:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587185.708085:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309986432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587185.708129:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587185.713688:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309986304 00000100:00100000:2.0:1788587185.713702:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309986304 00000100:00100000:2.0:1788587185.713766:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309986432 00000100:00100000:2.0:1788587185.713771:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309986432 00000100:00100000:2.0:1788587185.713791:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788587185.713821:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3472:x1875469309986304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587185.713847:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52625408 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587185.713923:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3472:x1875469309986304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (6469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.714995:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788587185.715017:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0350b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309986432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587185.715033:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52625408 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587185.715151:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0350b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309986432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (7021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587185.715158:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788587185.715435:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309986432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587185.715457:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309986304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587185.715589:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000001:00080000:2.0:1788587185.746302:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788587185.746317:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788587186.339917:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.339964:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.339997:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.340026:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.340052:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.340075:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.340100:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292111616 00000100:00100000:3.0:1788587186.340118:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292111616 00000100:00080000:3.0:1788587186.340146:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587186.340187:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292111232 00000100:00100000:3.0:1788587186.340190:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292111232 00000100:00080000:3.0:1788587186.340202:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587186.340220:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292111744 00000100:00100000:3.0:1788587186.340223:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292111744 00000100:00100000:3.0:1788587186.340245:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 309 00000100:00100000:3.0:1788587186.340255:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292111616:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587186.340334:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292111616:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 71us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587186.340341:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 309 00000100:00100000:3.0:1788587186.340357:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 310 00000100:00100000:3.0:1788587186.340363:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292111232:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587186.340404:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292111232:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 42us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587186.340411:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 310 00000100:00100000:3.0:1788587186.340424:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 311 00000100:00100000:3.0:1788587186.340431:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292111744:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587186.340455:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2412:x1875469292111744:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587186.340457:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292111104 00000100:00100000:3.0:1788587186.340463:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 311 00000100:00100000:1.0:1788587186.340465:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292111104 00000100:00080000:3.0:1788587186.340482:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587186.340503:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 387 00000100:00100000:1.0:1788587186.340511:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292111104:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587186.340545:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2412:x1875469292111104:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 35us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587186.340552:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 387 00000100:00100000:2.0:1788587186.341186:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292111360 00000100:00100000:2.0:1788587186.341192:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292111360 00000100:00100000:2.0:1788587186.341244:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292111488 00000100:00100000:2.0:1788587186.341248:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292111488 00000100:00100000:2.0:1788587186.341272:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 154 00000100:00100000:2.0:1788587186.341280:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:2412:x1875469292111360:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587186.341316:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:2412:x1875469292111360:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 37us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.341322:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 154 00000100:00100000:2.0:1788587186.341348:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00100000:2.0:1788587186.341355:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292111488:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587186.341379:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2412:x1875469292111488:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 25us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.341385:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00080000:3.0:1788587186.341644:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587186.341648:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788587186.346958:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587186.346967:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587186.347251:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788587186.347257:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587186.347525:0:13326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309986560:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587186.347619:0:13326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587186.350756:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.350909:0:13326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309986560:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587186.355035:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292111872 00000100:00100000:2.0:1788587186.355049:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292111872 00000100:00100000:2.0:1788587186.355160:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 226 00000100:00100000:2.0:1788587186.355171:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+65:12615:x1875469292111872:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587186.355214:0:13560:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587186.355320:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+65:12615:x1875469292111872:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 150us (4571us total) trans 0 rc 0/0 00000100:00080000:0.0:1788587186.355491:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587186.361102:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 226 00000100:00100000:0.0:1788587186.367874:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.369638:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292112000 00000100:00100000:2.0:1788587186.369651:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292112000 00000100:00100000:2.0:1788587186.369720:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 227 00000100:00100000:2.0:1788587186.369730:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+65:12615:x1875469292112000:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788587186.369827:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.369842:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.369855:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.369910:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.369918:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.369925:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.369946:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.369954:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.369960:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587186.369995:0:8126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788587186.370011:0:8126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587186.370023:0:8126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370033:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370040:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370046:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370053:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587186.370057:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370064:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370077:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:2.0:1788587186.370080:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587186.370084:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370091:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af600/0x419e1ae1f6344788 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370103:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370120:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370137:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370142:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587186.370145:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370152:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370160:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8cbf03491800) 00010000:00010000:2.0:1788587186.370162:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587186.370165:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370171:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af800/0x419e1ae1f634478f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370194:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370201:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370207:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370211:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587186.370214:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370229:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370237:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587186.370239:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587186.370242:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.370248:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f6344796 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587186.370316:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+65:12615:x1875469292112000:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 587us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.370324:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 227 00000100:00100000:3.0:1788587186.380921:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.381081:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292112256 00000100:00100000:0.0:1788587186.381090:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292112256 00000100:00100000:0.0:1788587186.381151:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 228 00000100:00100000:0.0:1788587186.381161:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0370dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+65:12615:x1875469292112256:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587186.381190:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587186.381210:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f634479d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b47 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381297:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381311:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381332:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587186.381362:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788587186.381454:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381462:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381469:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381475:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.381479:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381486:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381498:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587186.381501:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587186.381506:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381512:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381548:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f634479d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b47 expref: 67 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381558:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:0.0:1788587186.381560:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587186.381570:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f634479d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b47 expref: 67 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.381580:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483c00, rc 0) 00000100:00100000:0.0:1788587186.381637:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0370dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+66:12615:x1875469292112256:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 477us (724us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788587186.381644:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 228 00000100:00100000:1.0:1788587186.387698:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.387891:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292112384 00000100:00100000:2.0:1788587186.387900:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292112384 00000100:00100000:2.0:1788587186.387949:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 229 00000100:00100000:2.0:1788587186.387958:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+66:12615:x1875469292112384:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587186.387988:0:13560:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587186.388089:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+66:12615:x1875469292112384:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.388097:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 229 00000100:00100000:3.0:1788587186.393270:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.393714:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292112640 00000100:00100000:0.0:1788587186.393724:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292112640 00000100:00100000:0.0:1788587186.394644:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 230 00000100:00100000:0.0:1788587186.394659:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+66:12615:x1875469292112640:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587186.394678:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587186.394681:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788587186.394709:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fe00/0x419e1ae1f6344742 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b2b expref: 66 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.394731:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:0.0:1788587186.394737:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587186.394750:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63447b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b4e expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587186.395179:0:6472:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788587186.395383:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.395397:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.395407:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.395463:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63447b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b4e expref: 68 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.395478:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b4e expref: 67 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.395486:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:0.0:1788587186.395489:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587186.395492:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482000, rc 0) 00000100:00100000:0.0:1788587186.395558:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+67:12615:x1875469292112640:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 904us (2481us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788587186.395566:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 230 00000100:00100000:3.0:1788587186.403099:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.407392:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292112896 00000100:00100000:1.0:1788587186.407407:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292112896 00000100:00100000:1.0:1788587186.407475:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 231 00000100:00100000:1.0:1788587186.407486:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+67:12615:x1875469292112896:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587186.407543:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587186.407570:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f63447b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b4e expref: 67 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407591:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8bee00) 00010000:00010000:1.0:1788587186.407602:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587186.407623:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407637:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407647:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407711:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407720:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407727:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407819:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407826:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407833:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407838:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587186.407842:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407850:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407859:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587186.407862:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587186.407866:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407872:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407882:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407888:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407893:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407905:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587186.407909:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407915:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407923:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x539a1d20 (ffff8cbf07fc8200) 00010000:00010000:1.0:1788587186.407925:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587186.407927:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.407933:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x539a1d20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.408019:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+66:12615:x1875469292112896:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 535us (4928us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587186.408027:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 231 00000100:00100000:3.0:1788587186.414030:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.414120:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292113024 00000100:00100000:0.0:1788587186.414130:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292113024 00000100:00100000:0.0:1788587186.414189:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 232 00000100:00100000:0.0:1788587186.414198:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+66:12615:x1875469292113024:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587186.414217:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587186.414237:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63447d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b55 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.414295:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.414308:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.414320:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.415305:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f63447d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 68 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.415338:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 67 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.415487:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:0.0:1788587186.415492:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587186.415496:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26c00, rc 0) 00000100:00100000:0.0:1788587186.415614:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+67:12615:x1875469292113024:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1416us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587186.415623:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 232 00000100:00100000:3.0:1788587186.422673:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.422750:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292113280 00000100:00100000:0.0:1788587186.422759:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292113280 00000100:00100000:0.0:1788587186.422845:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 233 00000100:00100000:0.0:1788587186.422855:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+67:12615:x1875469292113280:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587186.422932:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.422949:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.422960:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587186.423453:0:6472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788587186.423466:0:6472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384172671301ns, next at 385172668310ns, rc = 0 00000004:00010000:2.0:1788587186.423555:0:6472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f6cc5ef reply state 00000000bcf1a024 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.423570:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.423587:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:2.0:1788587186.423590:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788587186.423594:0:6472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587186.423688:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+69:12615:x1875469292113280:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 833us (1023us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788587186.423697:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 233 00000100:00100000:3.0:1788587186.427257:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.427378:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292113408 00000100:00100000:2.0:1788587186.427388:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292113408 00000100:00100000:2.0:1788587186.427450:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 234 00000100:00100000:2.0:1788587186.427461:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+69:12615:x1875469292113408:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587186.427484:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587186.427505:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b5c expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.427564:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 70 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.427579:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 70 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.427597:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:2.0:1788587186.427600:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587186.427604:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae200, rc 0) 00000100:00100000:2.0:1788587186.427662:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+70:12615:x1875469292113408:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 202us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.427670:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 234 00000100:00100000:3.0:1788587186.432505:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.432604:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292113536 00000100:00100000:2.0:1788587186.432614:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292113536 00000100:00100000:2.0:1788587186.432674:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:2.0:1788587186.432684:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+9:2409:x1875469292113536:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788587186.433279:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+10:2409:x1875469292113536:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 588us (775us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788587186.433288:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:3.0:1788587186.435699:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.435774:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292113792 00000100:00100000:2.0:1788587186.435785:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292113792 00000100:00100000:2.0:1788587186.435870:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:2.0:1788587186.435880:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+70:12615:x1875469292113792:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587186.436540:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+71:12615:x1875469292113792:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 659us (847us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788587186.436548:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:3.0:1788587186.442422:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.442568:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292114048 00000100:00100000:0.0:1788587186.442577:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292114048 00000100:00100000:0.0:1788587186.442650:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 235 00000100:00100000:0.0:1788587186.442660:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+71:12615:x1875469292114048:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587186.442784:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+71:12615:x1875469292114048:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 125us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587186.442791:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 235 00000100:00100000:3.0:1788587186.447942:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.448027:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292114176 00000100:00100000:1.0:1788587186.448037:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292114176 00000100:00100000:1.0:1788587186.448102:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 236 00000100:00100000:1.0:1788587186.448119:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+71:12615:x1875469292114176:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587186.448138:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587186.448156:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b63 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.448227:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.448257:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.448268:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587186.448300:0:6473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587186.448317:0:6473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.448341:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63447f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b63 expref: 73 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.448370:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b63 expref: 72 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.448384:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:1.0:1788587186.448387:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587186.448391:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f200, rc 0) 00000100:00100000:1.0:1788587186.448442:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+72:12615:x1875469292114176:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 332us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587186.448450:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 236 00000100:00100000:3.0:1788587186.453644:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.453729:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292114304 00000100:00100000:1.0:1788587186.453738:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292114304 00000100:00100000:1.0:1788587186.453791:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:1.0:1788587186.453835:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+10:2409:x1875469292114304:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587186.453853:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587186.453884:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b6a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587186.453910:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bacb2, blocks: 0x1 00010000:00010000:1.0:1788587186.453928:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788587186.453932:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587186.453942:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 11 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.453961:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 11 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.453974:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fa00, rc 0) 00000100:00100000:1.0:1788587186.454030:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+11:2409:x1875469292114304:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 197us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587186.454037:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:3.0:1788587186.459154:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.459226:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292114560 00000100:00100000:0.0:1788587186.459237:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292114560 00000100:00100000:0.0:1788587186.459294:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 237 00000100:00100000:0.0:1788587186.459303:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf11b71050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+72:12615:x1875469292114560:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587186.459413:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf11b71050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+72:12615:x1875469292114560:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587186.459421:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 237 00000100:00100000:3.0:1788587186.465538:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.465643:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292114688 00000100:00100000:1.0:1788587186.465653:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292114688 00000100:00100000:1.0:1788587186.465708:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:1.0:1788587186.465719:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+11:12615:x1875469292114688:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587186.465736:0:8100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587186.465753:0:8100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b71 expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.465782:0:8100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 12 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.465847:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587186.465851:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587186.465858:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 12 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.465890:0:8100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 12 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.465903:0:8100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 12 pid: 8449 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.465917:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8100:1875469309986688:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587186.465989:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587186.478092:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.478643:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292114816 00000100:00100000:2.0:1788587186.478653:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292114816 00010000:00010000:2.0:1788587186.478692:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 13 pid: 8449 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587186.478740:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:2.0:1788587186.478750:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf06300050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+13:2410:x1875469292114816:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587186.478764:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587186.478789:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 13 pid: 8449 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.478856:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 13 pid: 8449 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.478879:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587186.478884:0:6458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587186.478892:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 13 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.478902:0:6458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 13 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.478936:0:6458:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 13 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587186.478950:0:6458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6458:1875469309986816:192.168.203.14@tcp:105: 00000100:00100000:2.0:1788587186.479023:0:6458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf348336c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788587186.479766:0:8100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f63447ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b6a expref: 13 pid: 8449 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.479784:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8100:1875469309986688:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587186.479841:0:8100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 12 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.479853:0:8100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f600, rc 0) 00000100:00100000:1.0:1788587186.479980:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+12:12615:x1875469292114688:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 14261us (14451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587186.479999:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:2.0:1788587186.492143:0:6458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6458:1875469309986816:192.168.203.14@tcp:105: 00010000:00010000:2.0:1788587186.492169:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587186.492241:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf06300050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+11:2410:x1875469292114816:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 13492us (14159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.492252:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:0.0:1788587186.495467:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.497396:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292114944 00000100:00100000:2.0:1788587186.497411:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292114944 00002000:00100000:2.0:1788587186.497465:0:8105:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8cbe03d9d880 x1875469292114944/t0(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:502/0 lens 504/0 e 0 to 0 dl 1788587197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587186.497490:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe03d9d880 with x1875469292114944 ext(0->12) 00002000:00010000:2.0:1788587186.497497:0:8105:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe03d9d880 00000100:00100000:2.0:1788587186.497537:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788587186.497546:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+11:2409:x1875469292114944:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587186.498308:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12266002-a8db-4050-aa6c-b9db12e6128d+13:2409:x1875469292114944:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 Request processed in 760us (2848us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788587186.498318:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00002000:00100000:2.0:1788587186.498326:0:8105:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8cbe03d9d880 x1875469292114944/t4294967321(0) o4->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:502/0 lens 504/448 e 0 to 0 dl 1788587197 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587186.498335:0:8105:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe03d9d880 with x1875469292114944 ext(0->12) 00002000:00010000:2.0:1788587186.498340:0:8105:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe03d9d880 00000100:00100000:3.0:1788587186.500716:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.503210:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292115072 00000100:00100000:2.0:1788587186.503224:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292115072 00000100:00100000:2.0:1788587186.503296:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 238 00000100:00100000:2.0:1788587186.503307:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+72:12615:x1875469292115072:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788587186.595303:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788587186.595354:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788587186.595382:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf34837cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788587186.595388:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf04a17700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf065b4600 00000020:00080000:3.0:1788587186.595391:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf343e9000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf10f39800 00000001:00080000:3.0:1788587186.595413:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788587186.595418:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788587186.595433:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788587186.595445:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf08114b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788587186.595448:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf36f5ef00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf08114480 00000020:00080000:3.0:1788587186.595450:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf36f5ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf3cd1c800 00000020:00080000:3.0:1788587186.595494:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788587186.595662:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1788587186.595679:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.595690:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.595699:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.595705:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587186.595709:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.595717:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.595747:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:3.0:1788587186.595750:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587186.595755:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.595761:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26200/0x419e1ae1f63447e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587186.595914:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309986944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788587186.595976:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587186.596180:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596189:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596194:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596198:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afe00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.596201:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596207:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596228:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cbf07fc8700) 00010000:00010000:0.0:1788587186.596230:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587186.596233:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596239:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afe00/0x419e1ae1f6344527 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596270:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596276:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596282:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596287:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.596289:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596295:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596303:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cbf07fc8d00) 00010000:00010000:0.0:1788587186.596305:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587186.596308:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596314:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf37105c00/0x419e1ae1f63445c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596358:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596365:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596370:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596374:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.596377:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596382:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596391:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:0.0:1788587186.596393:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587186.596396:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596402:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f634463f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596414:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596419:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596425:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596435:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.596439:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596446:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596454:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf07fc8e00) 00010000:00010000:0.0:1788587186.596456:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587186.596459:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596464:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afa00/0x419e1ae1f6344662 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596483:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596490:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596495:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596500:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.596503:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596509:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596528:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587186.596530:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587186.596534:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.596539:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae600/0x419e1ae1f6344726 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.596788:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587186.596820:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309987200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788587186.596853:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587186.596936:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309986944 00000100:00100000:0.0:1788587186.596943:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309986944 00000100:00100000:0.0:1788587186.596988:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309987200 00000100:00100000:0.0:1788587186.596991:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309987200 00000100:00100000:3.0:1788587186.597202:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587186.597210:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309987072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788587186.597237:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587186.597388:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+20:12615:x1875469292115072:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 94079us (96680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.597398:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 238 00000100:00100000:0.0:1788587186.599776:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309987072 00000100:00100000:0.0:1788587186.599790:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309987072 00000100:00100000:0.0:1788587186.599846:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788587186.599857:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309986944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788587186.599886:0:8101:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1788587186.599918:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bacb0, atime: 0x6a9bacb0, ctime: 0x6a9bacb0, blocks: 0xb 00010000:00010000:0.0:1788587186.599927:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.599942:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1788587186.599947:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587186.599953:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.599969:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.599998:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.600281:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788587186.600292:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3473:x1875469309987200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788587186.600453:0:8099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788587186.600456:0:8099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788587186 00002000:00010000:1.0:1788587186.600458:0:8099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788587186.600460:0:8099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788587186 -> 1788587186 00002000:00010000:1.0:1788587186.600462:0:8099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788587186.600517:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3473:x1875469309987200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (3663us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788587186.600524:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788587186.600542:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788587186.600549:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3474:x1875469309987072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788587186.600561:0:8099:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1788587186.600573:0:8099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.600589:0:8099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.600597:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788587186.600600:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587186.600611:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.600641:0:8099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.600654:0:8099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 12 pid: 8449 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.600668:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8099:1875469309987328:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587186.600737:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232240 going to sleep for 11 seconds 00010000:00010000:0.0:1788587186.600910:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.600936:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587186.603766:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469309986944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3903us (7782us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788587186.603778:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1788587186.605601:0:3473:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe051d2d80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788587186.605614:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309987200:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788587186.605697:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587186.605707:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.605721:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587186.605725:0:6461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.605737:0:6461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.605756:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.605763:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000742c235b/0x419e1ae1f634480d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.605829:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587186.605831:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587186.605833:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587186.605915:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587186.607504:0:3474:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788587186.607514:0:3474:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbf3fdb3800, transno 4294967308 00000004:00080000:2.0:1788587186.607535:0:3474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:2.0:1788587186.607568:0:3474:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbe05c19500 x1875469309986944/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587202 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788587186.607579:0:3474:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe05c19500/2, rc 0, transno 4294967311 00000100:00100000:2.0:1788587186.607583:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309986944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788587186.611196:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.611481:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8099:1875469309987328:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587186.611506:0:8099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.611776:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.612171:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292115328 00000100:00100000:2.0:1788587186.612179:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292115328 00010000:00010000:2.0:1788587186.612215:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 13 pid: 8449 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587186.612247:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:2.0:1788587186.612257:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+13:2410:x1875469292115328:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587186.612282:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587186.612288:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 13 pid: 8449 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.612301:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 13 pid: 8449 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.612332:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4eeb8e/0x419e1ae1f63445cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ad0 expref: 13 pid: 8449 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.612368:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587186.612372:0:6457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587186.612378:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.612387:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.612417:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587186.612470:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+12:2410:x1875469292115328:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 215us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.612478:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 101 00010000:00010000:1.0:1788587186.613686:0:8099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.613701:0:8099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.613713:0:8099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.613720:0:8099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.613745:0:8099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788587186.614837:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3474:x1875469309987072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14283us (17594us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788587186.614848:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788587186.614873:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292115200 00000100:00100000:1.0:1788587186.614879:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292115200 00000100:00100000:0.0:1788587186.614965:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:0.0:1788587186.614977:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+12:2411:x1875469292115200:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788587186.616437:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587186.616448:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.616461:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587186.616465:0:8116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.616476:0:8116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.616493:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.616517:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f6344814 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.616538:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587186.616539:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587186.616541:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788587186.616582:0:3474:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe051d0380/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788587186.616591:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309987072:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788587186.650196:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788587186.650213:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1788587186.650743:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788587186.651182:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2411:x1875469292115200:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 36202us (39988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.651194:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:2.0:1788587186.662514:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.664534:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292115584 00000100:00100000:3.0:1788587186.664548:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292115584 00000100:00100000:3.0:1788587186.664616:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 239 00000100:00100000:3.0:1788587186.664626:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+20:12615:x1875469292115584:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587186.664684:0:13560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587186.664714:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63447f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b63 expref: 20 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.664735:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:3.0:1788587186.664740:0:13560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587186.664769:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.665143:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.665167:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587186.665405:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8f39eb8 reply state 000000009a97d080 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.665418:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.665424:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:3.0:1788587186.665427:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587186.665430:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587186.665530:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+21:12615:x1875469292115584:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 904us (3024us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1788587186.665537:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 239 00000100:00100000:3.0:1788587186.668515:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.668663:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292115712 00000100:00100000:1.0:1788587186.668672:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292115712 00000100:00100000:1.0:1788587186.668732:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:1.0:1788587186.668743:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292115712:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788587186.669435:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788587186.669440:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788587186 -> 1788587185 00002000:00010000:1.0:1788587186.669443:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788587184 00002000:00010000:1.0:1788587186.669445:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788587186 -> 1788587185 00002000:00010000:1.0:1788587186.669448:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788587186.669652:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292115712:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 909us (1145us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788587186.669661:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:2.0:1788587186.672476:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.672532:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292115968 00000100:00100000:1.0:1788587186.672542:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292115968 00000100:00100000:1.0:1788587186.672601:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 240 00000100:00100000:1.0:1788587186.672610:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+21:12615:x1875469292115968:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788587186.672673:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.672690:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 21 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.672701:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.672735:0:6474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 21 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.672748:0:6474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 21 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.672779:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309987456:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587186.672886:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf05232cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587186.676606:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.676927:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292116096 00000100:00100000:1.0:1788587186.676930:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309987456:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788587186.676936:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292116096 00010000:00010000:3.0:1788587186.676977:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 22 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.677130:0:6474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587186.678117:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00100000:2.0:1788587186.678135:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+22:2410:x1875469292116096:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587186.678152:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587186.678244:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 22 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.678259:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 22 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.678281:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26c00/0x419e1ae1f63447dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b55 expref: 22 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.678315:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:2.0:1788587186.678319:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.678394:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.678402:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.678470:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587186.678531:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:2410:x1875469292116096:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 403us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.678538:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 102 00010000:00010000:1.0:1788587186.679393:0:6474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.679404:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.679435:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.679442:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.679449:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.679455:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587186.679459:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.679466:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.679479:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:1.0:1788587186.679491:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788587186.679497:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.679515:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f6344822 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587186.679767:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+20:12615:x1875469292115968:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 Request processed in 6959us (7777us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788587186.679778:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 240 00000100:00100000:2.0:1788587186.684386:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.684464:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292116224 00000100:00100000:0.0:1788587186.684474:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292116224 00000100:00100000:0.0:1788587186.684526:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:0.0:1788587186.684536:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2409:x1875469292116224:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788587186.684575:0:8099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.684595:0:8099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.684604:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587186.684621:0:8099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587186.684626:0:8099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.684661:0:8099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 8 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.684675:0:8099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 8 pid: 8100 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587186.684688:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8099:1875469309987584:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587186.684765:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587186.688493:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8099:1875469309987584:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587186.688537:0:8099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587186.691235:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587186.691604:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292116352 00000100:00100000:3.0:1788587186.691613:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292116352 00010000:00010000:3.0:1788587186.691652:0:6459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 9 pid: 8100 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587186.691718:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 103 00000100:00100000:3.0:1788587186.691728:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+9:2409:x1875469292116352:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587186.691743:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587186.691764:0:6459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 9 pid: 8100 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.691777:0:6459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 9 pid: 8100 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.691837:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f6344806 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b71 expref: 9 pid: 8100 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.691853:0:6459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587186.691857:0:6459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587186.691863:0:6459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.691882:0:6459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587186.691913:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587186.692163:0:8099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.692173:0:8099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.692195:0:8099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.692204:0:8099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.692224:0:8099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.692231:0:8099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587186.692235:0:8099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.692244:0:8099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.692256:0:8099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.692263:0:8099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f6344829 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587186.692351:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12266002-a8db-4050-aa6c-b9db12e6128d+8:2409:x1875469292116352:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 623us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587186.692358:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 103 00000100:00100000:2.0:1788587186.696561:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2409:x1875469292116224:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 12014us (12171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.696575:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:2.0:1788587186.700768:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.700941:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292116608 00000100:00100000:0.0:1788587186.700952:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292116608 00000100:00100000:0.0:1788587186.701002:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 241 00000100:00100000:0.0:1788587186.701053:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+20:12615:x1875469292116608:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788587186.701390:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.701408:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.701420:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.701757:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.701768:0:6472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 21 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.701777:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.701847:0:6472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 21 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.701863:0:6472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 21 pid: 13560 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587186.701877:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309987712:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587186.701962:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587186.710662:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.710760:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292116736 00000100:00100000:2.0:1788587186.710768:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292116736 00010000:00010000:2.0:1788587186.710840:0:6457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 22 pid: 13560 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587186.710895:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 104 00000100:00100000:2.0:1788587186.710904:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+22:2410:x1875469292116736:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587186.710923:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587186.710929:0:6457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 22 pid: 13560 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.710942:0:6457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 22 pid: 13560 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.710963:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:2.0:1788587186.710968:0:6457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.710978:0:6457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.711237:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.711260:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587186.711403:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae200/0x419e1ae1f63447ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b5c expref: 22 pid: 13560 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587186.711421:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309987712:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587186.711440:0:6472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.711448:0:6472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.711455:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587186.711620:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788587186.711760:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1788587186.711838:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1788587186.711906:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6472:1875469309987840:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788587186.711949:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587186.711973:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587186.711997:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309987840 00000100:00100000:0.0:1788587186.712001:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309987840 00000100:00100000:0.0:1788587186.712030:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788587186.712036:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6472:x1875469309987840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788587186.712091:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6472:x1875469309987840:12345-0@lo:1000:mdt00_000.0 Request processed in 55us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587186.712098:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788587186.712141:0:6472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788587186.712146:0:6472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:0.0:1788587186.712182:0:6472:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe051d2d80, transno 4294967322 00000004:00080000:0.0:1788587186.712191:0:6472:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe051d0380, transno 4294967323 00000100:00100000:0.0:1788587186.712197:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6472:1875469309987840:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788587186.712543:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788587186.712584:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6472:1875469309987968:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788587186.712614:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587186.712628:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587186.712899:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309987968 00000100:00100000:0.0:1788587186.712904:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309987968 00000100:00100000:0.0:1788587186.712926:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788587186.712932:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6472:x1875469309987968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788587186.713059:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6472:x1875469309987968:12345-0@lo:1000:mdt00_000.0 Request processed in 126us (443us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788587186.713066:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788587186.713094:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6472:1875469309987968:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788587186.713131:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713140:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713147:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713154:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.713158:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713165:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713178:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:0.0:1788587186.713181:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587186.713185:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713191:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344837 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713212:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713228:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713234:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713239:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.713242:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713248:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713255:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587186.713258:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587186.713264:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b40 expref: 25 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713274:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b40 expref: 25 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713284:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b40 expref: 25 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.713305:0:6472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b40 expref: 25 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587186.713316:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309988096:192.168.203.14@tcp:105: 00000100:00100000:2.0:1788587186.713483:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+25:2410:x1875469292116736:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 2579us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.713493:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 104 00000100:00100000:0.0:1788587186.714333:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587186.718768:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.719016:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6472:1875469309988096:192.168.203.14@tcp:105: 00010000:00010000:0.0:1788587186.719042:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719052:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f634477a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719082:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719095:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719106:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719127:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719134:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719140:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719145:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.719149:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719160:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719184:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587186.719187:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587186.719191:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719197:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634483e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719210:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719216:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719221:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719226:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587186.719229:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719235:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719240:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587186.719243:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587186.719245:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.719251:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344830 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587186.719458:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+24:12615:x1875469292116608:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 18406us (18697us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788587186.719468:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 241 00000020:00080000:0.0:1788587186.719474:0:6472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788587186.719998:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587186.720002:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587186.720646:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788587186.720665:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587186.727196:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.729269:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292116864 00000100:00100000:1.0:1788587186.729283:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292116864 00000100:00100000:1.0:1788587186.729344:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292117120 00000100:00100000:1.0:1788587186.729347:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292117120 00000100:00100000:1.0:1788587186.729366:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:1.0:1788587186.729375:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+25:12614:x1875469292116864:12345-192.168.203.14@tcp:49:lfs.0 00000100:00100000:1.0:1788587186.729499:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+25:12614:x1875469292116864:12345-192.168.203.14@tcp:49:lfs.0 Request processed in 124us (10738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587186.729507:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:1.0:1788587186.729525:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:1.0:1788587186.729531:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+24:12615:x1875469292117120:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788587186.730286:0:6476:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788587186.730391:0:6476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1788587186.730429:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.730445:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.730463:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.730472:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.730478:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.730485:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.730879:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788587186.730943:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+26:12615:x1875469292117120:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 1410us (3754us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788587186.730951:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000020:00080000:1.0:1788587186.730955:0:6476:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788587186.733815:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.733972:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292117376 00000100:00100000:1.0:1788587186.733981:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292117376 00000100:00100000:1.0:1788587186.734054:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 242 00000100:00100000:1.0:1788587186.734062:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+26:12614:x1875469292117376:12345-192.168.203.14@tcp:58:lfs.0 00000040:00080000:1.0:1788587186.734439:0:13560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788587186.734653:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+26:12614:x1875469292117376:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 589us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587186.734661:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 242 00010000:00010000:2.0:1788587186.738585:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587186.738599:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.738611:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587186.738616:0:6460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.738626:0:6460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.738644:0:6460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:2.0:1788587186.738648:0:6460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587186.738653:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.738659:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6344845 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587186.738677:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587186.738679:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587186.738681:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587186.738915:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309988224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587186.738929:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309988480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587186.739003:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587186.739078:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587186.739135:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309988352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587186.739159:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587186.739420:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309988224 00000100:00100000:3.0:1788587186.739429:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309988224 00000100:00100000:3.0:1788587186.739475:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309988352 00000100:00100000:3.0:1788587186.739478:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309988352 00000100:00100000:3.0:1788587186.739492:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788587186.739499:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309988224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587186.739519:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788587186.739558:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309988224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587186.739564:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788587186.739580:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788587186.739585:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469309988352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587186.739593:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788587186.739614:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469309988352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587186.739619:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788587186.740174:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309988352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587186.740208:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309988224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587186.740240:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309988480 00000100:00100000:2.0:1788587186.740244:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309988480 00000100:00100000:2.0:1788587186.740277:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788587186.740283:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309988480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587186.740313:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587186.740360:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309988480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587186.740366:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788587186.740597:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309988480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587186.773073:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587186.775413:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292117504 00000100:00100000:1.0:1788587186.775443:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292117504 00000100:00100000:0.0:1788587186.780135:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 243 00000100:00100000:0.0:1788587186.780149:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+26:12617:x1875469292117504:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587186.780170:0:6474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587186.780193:0:6474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f634484c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b78 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.780257:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.780271:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.780283:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.780297:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.780304:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.780310:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.781025:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.781043:0:6474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 27 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.781051:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.781085:0:6474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 27 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.781099:0:6474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 27 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587186.781123:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309988608:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587186.781274:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a62f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587186.783934:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587186.784022:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292117760 00000100:00100000:2.0:1788587186.784030:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292117760 00000100:00100000:2.0:1788587186.784080:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:2.0:1788587186.784089:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+28:6380:x1875469292117760:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788587186.784294:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+29:6380:x1875469292117760:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 205us (365us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788587186.784302:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:0.0:1788587186.784841:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6474:1875469309988608:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587186.784866:0:6474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587186.786371:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587186.786445:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292117888 00000100:00100000:0.0:1788587186.786453:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292117888 00010000:00010000:0.0:1788587186.786488:0:6458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 29 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587186.786523:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 105 00000100:00100000:0.0:1788587186.786531:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+29:2411:x1875469292117888:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587186.786544:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587186.786563:0:6458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 29 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.786575:0:6458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 29 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.786597:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634476c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b39 expref: 29 pid: 8126 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.786612:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587186.786617:0:6458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.786627:0:6458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.786635:0:6458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587186.786671:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587186.786732:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12266002-a8db-4050-aa6c-b9db12e6128d+28:2411:x1875469292117888:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 200us (366us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587186.786738:0:6474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587186.786740:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 105 00010000:00010000:1.0:1788587186.786752:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587186.786821:0:6474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788587186.786826:0:6474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587186.786847:0:6474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786859:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786870:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786877:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786884:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786889:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587186.786893:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786912:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786923:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:1.0:1788587186.786925:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587186.786938:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786945:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f6344853 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786961:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786968:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786975:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786985:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587186.786989:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.786995:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.787003:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cbf2c8be500) 00010000:00010000:1.0:1788587186.787005:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587186.787009:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.787014:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f634485a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.787048:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f634484c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b78 expref: 28 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.787074:0:6474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b78 expref: 27 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587186.787082:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:1.0:1788587186.787084:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587186.787086:0:6474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27400, rc 0) 00000100:00100000:1.0:1788587186.787138:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+27:12617:x1875469292117504:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 6992us (14074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587186.787145:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 243 00000100:00100000:1.0:1788587187.251937:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309988736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587187.252001:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587187.252183:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309988736 00000100:00100000:0.0:1788587187.252191:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309988736 00000100:00100000:0.0:1788587187.252244:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788587187.252255:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309988736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587187.252296:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587187.252346:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309988736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587187.252362:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788587187.252405:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309988736:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788587187.627058:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587187.674692:0:14320:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587187.674702:0:14320:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587187.674967:0:14320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788587187.674975:0:14320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788587187.758323:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587187.758344:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587187.758390:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788587187.758398:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587187.758518:0:13326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309988864:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587187.758616:0:13326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587187.765462:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587187.765494:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292118016 00000100:00100000:0.0:1788587187.765502:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292118016 00000100:00100000:0.0:1788587187.765556:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 244 00000100:00100000:0.0:1788587187.765566:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+28:12629:x1875469292118016:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587187.765599:0:6472:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587187.765694:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+28:12629:x1875469292118016:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587187.765702:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 244 00000100:00100000:3.0:1788587187.770348:0:13326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13326:1875469309988864:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587187.780285:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587187.780909:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292118272 00000100:00100000:1.0:1788587187.780920:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292118272 00000100:00100000:1.0:1788587187.780973:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 245 00000100:00100000:1.0:1788587187.780982:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+27:12629:x1875469292118272:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587187.781001:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587187.781021:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344868 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b7f expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587187.781128:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634486f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587187.781143:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634486f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587187.781170:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634486f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587187.781182:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788587187.781306:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f000/0x419e1ae1f6344868 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b7f expref: 30 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587187.781335:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634486f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b7f expref: 29 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587187.781343:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:1.0:1788587187.781346:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587187.781349:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f800, rc 0) 00000100:00100000:1.0:1788587187.781405:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12266002-a8db-4050-aa6c-b9db12e6128d+29:12629:x1875469292118272:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 424us (1129us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788587187.781412:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 245 00000100:00100000:0.0:1788587187.799948:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587187.799999:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587187.800160:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292118656 00000100:00100000:3.0:1788587187.800170:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292118656 00000100:00100000:2.0:1788587187.800194:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292118528 00000100:00100000:2.0:1788587187.800198:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292118528 00000100:00100000:3.0:1788587187.800235:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788587187.800235:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 246 00000100:00100000:3.0:1788587187.800245:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+30:2412:x1875469292118656:12345-192.168.203.14@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788587187.800245:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+30:12629:x1875469292118528:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788587187.800260:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587187.800283:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f800/0x419e1ae1f634486f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b7f expref: 30 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587187.800298:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:3.0:1788587187.800303:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587187.800307:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587187.800319:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587187.800330:0:6474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587187.800359:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12266002-a8db-4050-aa6c-b9db12e6128d+29:2412:x1875469292118656:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 116us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587187.800365:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00010000:00010000:2.0:1788587187.800519:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587187.800527:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587187.800534:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587187.800540:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afc00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587187.800666:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587187.800676:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587187.800685:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:2.0:1788587187.800688:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587187.800692:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587187.800698:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062afc00/0x419e1ae1f634487d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587187.800847:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+29:12629:x1875469292118528:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 603us (908us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788587187.800855:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 246 00000040:00080000:3.0:1788587187.803281:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587187.803287:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587187.806955:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788587187.806974:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587187.818196:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587187.819153:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292118912 00000100:00100000:2.0:1788587187.819165:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292118912 00000100:00100000:2.0:1788587187.819230:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:2.0:1788587187.819249:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+29:12629:x1875469292118912:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587187.819494:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+30:12629:x1875469292118912:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 246us (1307us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788587187.819502:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00010000:00010000:0.0:1788587188.651223:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587189.616879:0:14371:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587189.616888:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587189.616933:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788587189.616938:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788587189.674935:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587189.758028:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587189.758064:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292119168 00000100:00100000:0.0:1788587189.758075:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292119168 00000100:00100000:0.0:1788587189.758143:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 247 00000100:00100000:0.0:1788587189.758155:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+30:12649:x1875469292119168:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587189.758178:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587189.758199:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344884 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b86 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587189.758299:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634488b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587189.758321:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634488b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587189.758334:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634488b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587189.758347:0:6473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788587189.758475:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27200/0x419e1ae1f6344884 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b86 expref: 33 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587189.758491:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634488b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b86 expref: 32 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587189.758500:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587189.758503:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788587189.758506:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26e00, rc 0) 00000100:00100000:0.0:1788587189.758562:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+32:12649:x1875469292119168:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 409us (539us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788587189.758569:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 247 00000100:00080000:0.0:1788587189.758594:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587189.762927:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587189.769919:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292119296 00000100:00100000:1.0:1788587189.769935:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292119296 00000100:00100000:1.0:1788587189.769994:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 248 00000100:00100000:1.0:1788587189.770003:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+32:12649:x1875469292119296:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788587189.770119:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770137:0:8126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770151:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770188:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770196:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770202:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770209:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587189.770213:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770220:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770232:0:8126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:1.0:1788587189.770236:0:8126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587189.770241:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587189.770247:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344899 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587189.770461:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+32:12649:x1875469292119296:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 322us (7409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587189.770471:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 248 00000100:00100000:3.0:1788587189.893019:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587189.893133:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292119424 00000100:00100000:2.0:1788587189.893142:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292119424 00000100:00080000:0.0:1788587189.893192:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587189.893218:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:2.0:1788587189.893235:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2411:x1875469292119424:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:2.0:1788587189.893252:0:8100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587189.893272:0:8100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f63448a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b8d expref: -99 pid: 8100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587189.893298:0:8100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9bacb1, atime: 0x6a9bacb0, ctime: 0x6a9bacb1, blocks: 0xb 00010000:00010000:2.0:1788587189.893317:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788587189.893322:0:8100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587189.893331:0:8100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f63448a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b8d expref: 8 pid: 8100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587189.893349:0:8100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f63448a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b8d expref: 8 pid: 8100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587189.893381:0:8100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062af800, rc 0) 00000100:00100000:2.0:1788587189.893440:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+8:2411:x1875469292119424:12345-192.168.203.14@tcp:101:cat.0 Request processed in 213us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587189.893448:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:0.0:1788587189.901707:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587189.901843:0:8107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292119552 00000100:00100000:1.0:1788587189.901854:0:8107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292119552 00002000:00100000:1.0:1788587189.901907:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8cbe03d9d180 x1875469292119552/t0(0) o3->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:505/0 lens 488/0 e 0 to 0 dl 1788587200 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587189.901932:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe03d9d180 with x1875469292119552 ext(0->4095) 00002000:00010000:1.0:1788587189.901938:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe03d9d180 00000100:00100000:1.0:1788587189.901978:0:8107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788587189.901989:0:8107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+8:2411:x1875469292119552:12345-192.168.203.14@tcp:3:cat.0 00000100:00100000:1.0:1788587189.902300:0:8107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12266002-a8db-4050-aa6c-b9db12e6128d+8:2411:x1875469292119552:12345-192.168.203.14@tcp:3:cat.0 Request processed in 311us (601us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788587189.902309:0:8107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00002000:00100000:1.0:1788587189.902316:0:8107:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8cbe03d9d180 x1875469292119552/t0(0) o3->12266002-a8db-4050-aa6c-b9db12e6128d@192.168.203.14@tcp:505/0 lens 488/4536 e 0 to 0 dl 1788587200 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587189.902324:0:8107:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe03d9d180 with x1875469292119552 ext(0->4095) 00002000:00010000:1.0:1788587189.902327:0:8107:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe03d9d180 00000100:00100000:3.0:1788587190.315229:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309989120:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.315317:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587190.315423:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587190.315437:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309988992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587190.315471:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587190.315558:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309989120 00000100:00100000:2.0:1788587190.315566:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309989120 00000100:00100000:2.0:1788587190.315620:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788587190.315630:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309989120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587190.315770:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309989248:0@lo:400:kworker.0 00000100:00100000:1.0:1788587190.315818:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587190.315852:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309989248 00000100:00100000:1.0:1788587190.315856:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309989248 00000100:00100000:1.0:1788587190.315891:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788587190.315898:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309989248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587190.315933:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309989248:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587190.315940:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788587190.315985:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309989248:0@lo:400:kworker.0 00000100:00100000:1.0:1788587190.316010:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309988992 00000100:00100000:1.0:1788587190.316014:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309988992 00000100:00100000:1.0:1788587190.316033:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788587190.316038:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309988992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587190.316068:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309988992:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587190.316074:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788587190.316118:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309988992:0@lo:400:kworker.0 00000100:00100000:2.0:1788587190.316256:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469309989120:12345-0@lo:400:kworker.0 Request processed in 628us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587190.316263:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788587190.321853:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309989376:0@lo:400:kworker.0 00000100:00100000:1.0:1788587190.321942:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587190.322081:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309989504:0@lo:400:kworker.0 00000100:00100000:2.0:1788587190.322126:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587190.322176:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309989504 00000100:00100000:2.0:1788587190.322184:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309989504 00000100:00100000:2.0:1788587190.322237:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788587190.322247:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309989504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587190.322315:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309989504:12345-0@lo:400:kworker.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587190.322323:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788587190.322366:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309989504:0@lo:400:kworker.0 00000100:00100000:2.0:1788587190.322475:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309989376 00000100:00100000:2.0:1788587190.322479:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309989376 00000100:00100000:2.0:1788587190.322508:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788587190.322530:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309989376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.325165:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469309989120:0@lo:400:kworker.0 00000100:00100000:0.0:1788587190.325423:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309989760:0@lo:400:kworker.0 00000100:00100000:0.0:1788587190.325475:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587190.325501:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309990272:0@lo:400:kworker.0 00000100:00100000:0.0:1788587190.325520:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587190.325536:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788587190.325553:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309989632:0@lo:400:kworker.0 00000100:00100000:0.0:1788587190.325574:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587190.325591:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309990144:0@lo:400:kworker.0 00000100:00100000:0.0:1788587190.325608:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587190.325631:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309989760 00000100:00100000:0.0:1788587190.325636:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309989760 00000100:00100000:0.0:1788587190.325672:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309990272 00000100:00100000:0.0:1788587190.325674:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309990272 00000100:00100000:0.0:1788587190.325686:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309989632 00000100:00100000:0.0:1788587190.325688:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309989632 00000100:00100000:0.0:1788587190.325698:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309990144 00000100:00100000:0.0:1788587190.325701:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309990144 00000100:00100000:0.0:1788587190.325715:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788587190.325723:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309989760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.332504:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788587190.332530:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309990272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.332635:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309990272:12345-0@lo:400:kworker.0 Request processed in 117us (7113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587190.332643:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788587190.332668:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788587190.332676:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309989632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.332706:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309989632:12345-0@lo:400:kworker.0 Request processed in 31us (7132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587190.332712:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788587190.332737:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788587190.332745:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309990144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.332775:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309990144:12345-0@lo:400:kworker.0 Request processed in 32us (7166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587190.332781:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788587190.332860:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309989632:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.332883:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309990144:0@lo:400:kworker.0 00010000:00080000:3.0:1788587190.332895:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe06894e00 x1875469309990272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587190.332906:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309990272:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.332956:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309990016:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333008:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587190.333040:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309990528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333059:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587190.333078:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788587190.333094:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309989888:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333114:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587190.333132:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309990400:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333151:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587190.333196:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309990016 00000100:00100000:3.0:1788587190.333201:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309990016 00000100:00100000:3.0:1788587190.333231:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309990528 00000100:00100000:3.0:1788587190.333234:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309990528 00000100:00100000:3.0:1788587190.333245:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309989888 00000100:00100000:3.0:1788587190.333247:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309989888 00000100:00100000:3.0:1788587190.333257:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309990400 00000100:00100000:3.0:1788587190.333259:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309990400 00000100:00100000:3.0:1788587190.333272:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788587190.333279:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309990016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333313:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309990016:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587190.333318:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788587190.333330:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788587190.333336:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309990528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333361:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309990528:12345-0@lo:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587190.333366:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788587190.333375:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788587190.333389:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309989888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333418:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309989888:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587190.333423:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788587190.333435:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587190.333441:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309990400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333464:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309990400:12345-0@lo:400:kworker.0 Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587190.333471:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587190.333499:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309989888:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333509:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309990400:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333519:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309990016:0@lo:400:kworker.0 00000100:00100000:3.0:1788587190.333527:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309990528:0@lo:400:kworker.0 00000100:00080000:3.0:1788587190.333566:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587190.333570:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587190.333572:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587190.333575:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587190.334216:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309989760:12345-0@lo:400:kworker.0 Request processed in 8493us (8740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587190.334224:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00080000:3.0:1788587190.334308:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03d9d500 x1875469309989760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587190.334320:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309989760:0@lo:400:kworker.0 00000100:00100000:2.0:1788587190.334448:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469309989376:12345-0@lo:400:kworker.0 Request processed in 11917us (12504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587190.334456:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788587190.342052:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469309989376:0@lo:400:kworker.0 00010000:00010000:2.0:1788587190.699630:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587190.828376:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309990656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587190.828448:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587190.828557:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309990656 00000100:00100000:1.0:1788587190.828565:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309990656 00000100:00100000:1.0:1788587190.828609:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788587190.828617:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469309990656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587190.828648:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587190.828698:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469309990656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587190.828705:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788587190.829054:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309990656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587190.831691:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587190.831710:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309990784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587190.831770:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587190.833305:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309990784 00000100:00100000:3.0:1788587190.833318:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309990784 00000100:00100000:3.0:1788587190.833370:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788587190.833380:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309990784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587190.833415:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587190.833484:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309990784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587190.833492:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788587190.834556:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309990784:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788587190.902658:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1788587191.445220:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587191.445251:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587191.445272:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587191.445288:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587191.445303:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587191.445318:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587191.445336:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587191.445358:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292119680 00000100:00100000:3.0:1788587191.445367:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292119680 00000100:00100000:3.0:1788587191.445412:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 389 00000100:00100000:3.0:1788587191.445422:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292119680:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587191.445486:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292119680:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587191.445493:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 389 00000100:00100000:3.0:1788587191.445520:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292119808 00000100:00100000:3.0:1788587191.445524:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292119808 00000100:00100000:3.0:1788587191.445551:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292120320 00000100:00100000:3.0:1788587191.445554:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292120320 00000100:00100000:3.0:1788587191.445566:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292119936 00000100:00100000:3.0:1788587191.445568:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292119936 00000100:00100000:3.0:1788587191.445580:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292120448 00000100:00100000:3.0:1788587191.445582:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292120448 00000100:00100000:3.0:1788587191.445596:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 318 00000100:00100000:3.0:1788587191.445602:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+32:2410:x1875469292119808:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587191.445641:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+32:2410:x1875469292119808:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587191.445648:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 318 00000100:00100000:3.0:1788587191.445661:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 319 00000100:00100000:3.0:1788587191.445666:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292120320:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587191.445684:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292120320:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 19us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587191.445690:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 319 00000100:00100000:3.0:1788587191.445701:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 320 00000100:00100000:3.0:1788587191.445706:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292119936:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587191.445727:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292119936:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 21us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587191.445732:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 320 00000100:00100000:3.0:1788587191.445743:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 321 00000100:00100000:3.0:1788587191.445749:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292120448:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587191.445771:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2409:x1875469292120448:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587191.445776:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 321 00000100:00100000:3.0:1788587191.445809:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292120064 00000100:00100000:3.0:1788587191.445813:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292120064 00000100:00100000:3.0:1788587191.445835:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292120192 00000100:00100000:3.0:1788587191.445837:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292120192 00000100:00100000:3.0:1788587191.445853:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 160 00000100:00100000:3.0:1788587191.445858:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292120064:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587191.445889:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+8:2410:x1875469292120064:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 31us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587191.445894:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 160 00000100:00100000:3.0:1788587191.445904:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 161 00000100:00100000:3.0:1788587191.445909:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292120192:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587191.445924:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2409:x1875469292120192:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 16us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587191.445930:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 161 00000100:00080000:3.0:1788587191.445955:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587191.445959:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587191.445962:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587191.445963:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587191.724184:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587191.851284:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309991040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587191.851365:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587191.851435:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587191.851441:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309990912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587191.851472:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587191.851586:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309991040 00000100:00100000:2.0:1788587191.851595:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309991040 00000100:00100000:2.0:1788587191.851644:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309990912 00000100:00100000:2.0:1788587191.851648:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309990912 00000100:00100000:0.0:1788587191.851658:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788587191.851771:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309991040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587191.851823:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587191.851868:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469309991040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587191.853389:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309991040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587191.853489:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe051d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309991168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587191.853537:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587191.853591:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309991168 00000100:00100000:1.0:1788587191.853597:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309991168 00000100:00100000:1.0:1788587191.853635:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788587191.853644:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309991168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587191.853676:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587191.853718:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309991168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587191.853725:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788587191.853755:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe051d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309991168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587191.860713:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788587191.860732:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3b8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309990912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587191.860762:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587191.860899:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3b8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309990912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 173us (9425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587191.860908:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788587191.860973:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309990912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587191.879022:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000001:00080000:2.0:1788587191.928992:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1788587191.929010:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788587191.939157:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788587191.939183:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf36a62480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788587191.939189:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf3a433a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf36a62780 00000020:00080000:1.0:1788587191.939192:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf3a433b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf3bf1f800 00000020:00080000:1.0:1788587191.939245:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788587191.939309:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788587191.939554:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788587191.940477:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587191.940491:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587191.940500:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587191.940506:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587191.940510:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587191.940519:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587191.940536:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:0.0:1788587191.940539:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587191.940543:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587191.940550:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f634481b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587192.363225:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309991296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587192.363308:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587192.364087:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309991296 00000100:00100000:3.0:1788587192.364098:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309991296 00000100:00100000:3.0:1788587192.364153:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788587192.364163:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309991296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587192.364204:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1788587192.364272:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309991296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587192.364279:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788587192.364534:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309991296:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788587192.429339:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587192.748015:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587192.944506:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587192.944516:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587192.944558:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788587192.944572:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788587193.772376:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587194.799747:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587194.845981:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587194.846221:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292120576 00000100:00100000:3.0:1788587194.846232:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292120576 00000100:00100000:3.0:1788587194.846324:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 249 00000100:00100000:3.0:1788587194.846348:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+18:12294:x1875469292120576:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788587194.846463:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+18:12294:x1875469292120576:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 Request processed in 117us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587194.846472:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 249 00000100:00080000:0.0:1788587194.848705:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587194.855160:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587194.855300:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292120704 00000100:00100000:3.0:1788587194.855311:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292120704 00000100:00100000:3.0:1788587194.855391:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 250 00000100:00100000:3.0:1788587194.855402:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:12294:x1875469292120704:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788587194.855507:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12266002-a8db-4050-aa6c-b9db12e6128d+5:12294:x1875469292120704:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587194.855515:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 250 00000100:00080000:0.0:1788587194.856183:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587194.861319:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587194.861614:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292120960 00000100:00100000:0.0:1788587194.861624:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292120960 00000100:00100000:0.0:1788587194.861685:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:0.0:1788587194.861696:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:12294:x1875469292120960:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587194.862421:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+19:12294:x1875469292120960:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 723us (2703us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788587194.862430:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:2.0:1788587195.215558:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587195.215717:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292121088 00000100:00100000:0.0:1788587195.215726:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292121088 00000100:00100000:0.0:1788587195.215831:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 251 00000100:00100000:0.0:1788587195.215841:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+5:13107:x1875469292121088:12345-192.168.203.14@tcp:101:lsof.0 00010000:00010000:0.0:1788587195.215860:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587195.215881:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27a00/0x419e1ae1f63448a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5b94 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587195.215957:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27c00/0x419e1ae1f63448ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587195.215981:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27c00/0x419e1ae1f63448ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587195.215993:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27c00/0x419e1ae1f63448ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587195.216034:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587195.216038:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587195.216072:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27c00/0x419e1ae1f63448ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587195.216112:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27a00/0x419e1ae1f63448a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b94 expref: 7 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587195.216131:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27c00/0x419e1ae1f63448ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b94 expref: 6 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587195.216139:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:0.0:1788587195.216142:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587195.216146:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27c00, rc 0) 00000100:00100000:0.0:1788587195.216203:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bb361c2-21de-4228-8a96-92f24b49adc6+6:13107:x1875469292121088:12345-192.168.203.14@tcp:101:lsof.0 Request processed in 363us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587195.216211:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 251 00000100:00080000:3.0:1788587195.216699:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587195.437311:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309991808:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.437378:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587195.437442:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309992320:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.437483:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587195.437516:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309992832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.437538:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587195.437564:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788587195.437581:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309991680:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.437605:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587195.437623:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309992192:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.437646:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587195.437663:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309992704:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.437684:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587195.437985:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309992320 00000100:00100000:2.0:1788587195.438064:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309992320 00000100:00100000:2.0:1788587195.438118:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309992832 00000100:00100000:2.0:1788587195.438121:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309992832 00000100:00100000:2.0:1788587195.438146:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788587195.438157:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309992320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.438210:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309992320:12345-0@lo:400:kworker.0 Request processed in 56us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587195.438218:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788587195.438236:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788587195.438243:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309992832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.438272:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309992832:12345-0@lo:400:kworker.0 Request processed in 30us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587195.438278:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788587195.438479:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309991680 00000100:00100000:0.0:1788587195.438484:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309991680 00000100:00100000:0.0:1788587195.438515:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788587195.438522:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309991680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587195.438560:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309991680:12345-0@lo:400:kworker.0 Request processed in 39us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587195.438578:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788587195.438605:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309991808 00000100:00100000:0.0:1788587195.438608:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309991808 00000100:00100000:0.0:1788587195.438632:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309992192 00000100:00100000:0.0:1788587195.438635:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309992192 00000100:00100000:0.0:1788587195.438654:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309992704 00000100:00100000:0.0:1788587195.438658:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309992704 00000100:00100000:0.0:1788587195.438673:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788587195.438679:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309991808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587195.438735:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469309991808:12345-0@lo:400:kworker.0 Request processed in 55us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587195.438743:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788587195.438756:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788587195.438761:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309992192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587195.438789:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469309992192:12345-0@lo:400:kworker.0 Request processed in 27us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587195.439085:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788587195.439100:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788587195.439107:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309992704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587195.439139:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469309992704:12345-0@lo:400:kworker.0 Request processed in 34us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587195.439145:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:0.0:1788587195.439193:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587195.439198:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587195.439200:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587195.439515:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309991680:0@lo:400:kworker.0 00010000:00080000:2.0:1788587195.439531:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3fdb2a00 x1875469309992192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587195.439549:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469309992192:0@lo:400:kworker.0 00010000:00080000:2.0:1788587195.439562:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f29500 x1875469309992704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587195.439756:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469309992704:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.439772:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469309991808:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.439783:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309992320:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440271:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309991424:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440334:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587195.440372:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309991936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440397:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587195.440417:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309992448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440438:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587195.440457:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309992960:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440473:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587195.440494:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788587195.440500:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309991552:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440520:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587195.440538:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309992064:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440584:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587195.440604:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309992576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440623:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587195.440653:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309991936 00000100:00100000:3.0:1788587195.440659:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309991936 00000100:00100000:3.0:1788587195.440702:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788587195.440710:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309991936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.440757:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309991936:12345-0@lo:400:kworker.0 Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587195.440763:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788587195.440785:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309992448 00000100:00100000:3.0:1788587195.440788:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309992448 00000100:00100000:2.0:1788587195.441473:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309992832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.441540:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309991552 00000100:00100000:2.0:1788587195.441545:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309991552 00000100:00100000:2.0:1788587195.441583:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309992064 00000100:00100000:2.0:1788587195.441586:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309992064 00000100:00100000:2.0:1788587195.441608:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309992576 00000100:00100000:2.0:1788587195.441611:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309992576 00000100:00100000:2.0:1788587195.441625:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788587195.441631:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309991552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.441675:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469309991552:12345-0@lo:400:kworker.0 Request processed in 43us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587195.441681:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788587195.441707:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788587195.441713:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309992064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.441737:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469309992064:12345-0@lo:400:kworker.0 Request processed in 24us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587195.441742:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788587195.441760:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788587195.441765:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309992576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.441787:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469309992576:12345-0@lo:400:kworker.0 Request processed in 22us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587195.441906:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309992960 00000100:00100000:3.0:1788587195.441909:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309992960 00000100:00100000:3.0:1788587195.441925:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587195.441930:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309992448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.441959:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309992448:12345-0@lo:400:kworker.0 Request processed in 29us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587195.442188:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587195.442206:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788587195.442213:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309992960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.442243:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309992960:12345-0@lo:400:kworker.0 Request processed in 31us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587195.442248:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788587195.443230:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469309991552:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.443253:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469309992064:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.443277:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469309992576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.443288:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309991936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.443443:0:3472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788587195.443448:0:3472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788587195.443467:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309992448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587195.443478:0:3472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788587195.443482:0:3472:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe05c19500, transno 4294967311 00000100:00100000:3.0:1788587195.443502:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309992960:0@lo:400:kworker.0 00000100:00100000:2.0:1788587195.444782:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788587195.445223:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309991424 00000100:00100000:0.0:1788587195.445231:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309991424 00000100:00100000:0.0:1788587195.445277:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788587195.445285:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309991424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587195.445366:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5a87955-d364-4ecd-b672-456c35aa135f+24:3472:x1875469309991424:12345-0@lo:400:kworker.0 Request processed in 82us (5031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587195.445373:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00080000:0.0:1788587195.445399:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587195.445403:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587195.445406:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587195.446000:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469309991424:0@lo:400:kworker.0 00010000:00010000:1.0:1788587195.819113:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587195.947156:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587195.947181:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309993088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587195.947247:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587195.947785:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309993088 00000100:00100000:3.0:1788587195.947815:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309993088 00000100:00100000:3.0:1788587195.947862:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788587195.947871:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309993088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587195.947904:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587195.952530:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309993216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587195.952608:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587195.952694:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309993216 00000100:00100000:2.0:1788587195.952703:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309993216 00000100:00100000:2.0:1788587195.952748:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788587195.952757:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309993216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587195.952781:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587195.952842:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309993216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587195.952849:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788587195.952898:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309993216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587195.954374:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309993088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6496us (7119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587195.954386:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788587195.956178:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309993088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587196.563673:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587196.563714:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587196.563754:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587196.563776:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587196.563819:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587196.563837:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587196.563862:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587196.563901:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292121472 00000100:00100000:1.0:1788587196.563910:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292121472 00000100:00100000:1.0:1788587196.563962:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292121984 00000100:00100000:1.0:1788587196.563966:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292121984 00000100:00100000:1.0:1788587196.563980:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292121344 00000100:00100000:1.0:1788587196.563982:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292121344 00000100:00100000:1.0:1788587196.563994:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292121856 00000100:00100000:1.0:1788587196.563996:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292121856 00000100:00100000:1.0:1788587196.564012:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 328 00000100:00100000:1.0:1788587196.564021:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292121472:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587196.564099:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292121472:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 79us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587196.564107:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 328 00000100:00100000:1.0:1788587196.564124:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 329 00000100:00100000:1.0:1788587196.564130:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292121984:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587196.564154:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2410:x1875469292121984:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587196.564160:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 329 00000100:00100000:1.0:1788587196.564171:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 330 00000100:00100000:1.0:1788587196.564191:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:2410:x1875469292121344:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587196.564223:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:2410:x1875469292121344:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 33us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587196.564230:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 330 00000100:00100000:1.0:1788587196.564242:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 331 00000100:00100000:1.0:1788587196.564247:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2410:x1875469292121856:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587196.564392:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2410:x1875469292121856:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 143us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587196.564398:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 331 00000100:00080000:1.0:1788587196.564418:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587196.564421:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587196.564432:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292121728 00000100:00100000:1.0:1788587196.564436:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292121728 00000100:00100000:1.0:1788587196.564463:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292121600 00000100:00100000:1.0:1788587196.564466:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292121600 00000100:00100000:1.0:1788587196.564487:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00100000:1.0:1788587196.564494:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe051d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292121728:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587196.564518:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe051d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2410:x1875469292121728:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587196.564524:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00100000:1.0:1788587196.564535:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 167 00000100:00100000:1.0:1788587196.564541:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292121600:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587196.564563:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12266002-a8db-4050-aa6c-b9db12e6128d+7:2410:x1875469292121600:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587196.564569:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 167 00000100:00080000:1.0:1788587196.564595:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587196.564598:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587196.576169:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292121216 00000100:00100000:3.0:1788587196.576183:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292121216 00000100:00100000:3.0:1788587196.576297:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 391 00000100:00100000:3.0:1788587196.576307:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2410:x1875469292121216:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587196.576395:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2410:x1875469292121216:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 90us (12732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587196.576404:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 391 00010000:00010000:0.0:1788587196.843235:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587196.971193:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309993344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587196.971273:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587196.974340:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309993344 00000100:00100000:3.0:1788587196.974358:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309993344 00000100:00100000:3.0:1788587196.974406:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788587196.974416:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309993344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587196.974453:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587196.975908:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309993600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587196.976198:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587196.976248:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587196.976256:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309993472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587196.976325:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309993344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1908us (5049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587196.976335:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788587196.976763:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587196.976773:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309993344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587196.976817:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309993600 00000100:00100000:1.0:1788587196.976823:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309993600 00000100:00100000:1.0:1788587196.976856:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309993472 00000100:00100000:1.0:1788587196.976859:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309993472 00000100:00100000:1.0:1788587196.977199:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587196.977207:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309993600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587196.977239:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587196.977552:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309993600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 344us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587196.977560:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587196.977575:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788587196.977582:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309993472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587196.977592:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587196.977618:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309993472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587196.977624:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788587196.977658:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309993472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587196.977676:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309993600:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1788587197.003520:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788587197.003537:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788587197.003737:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788587197.003746:0:6505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788587197.483577:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587197.483600:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309993728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587197.483667:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587197.485132:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309993728 00000100:00100000:0.0:1788587197.485144:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309993728 00000100:00100000:0.0:1788587197.485209:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788587197.485219:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf080f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309993728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587197.485283:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587197.485364:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf080f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469309993728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587197.485371:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788587197.485589:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469309993728:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587197.869575:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587198.900310:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587199.402475:0:14574:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:46:37 (1788587197) 00010000:00010000:1.0:1788587199.921072:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587200.556469:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309994112:0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.556543:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587200.556598:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309994624:0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.556627:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587200.556644:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309995136:0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.556662:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587200.556683:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788587200.556687:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309993984:0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.556704:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587200.556719:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309994496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.556734:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587200.556747:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309995008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.556763:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587200.556828:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309994112 00000100:00100000:3.0:1788587200.556836:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309994112 00000100:00100000:3.0:1788587200.556877:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788587200.556885:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf2c3f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309994112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557002:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309994240:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557042:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587200.557060:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309994752:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557078:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587200.557096:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309995264:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557113:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587200.557129:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788587200.557135:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309993856:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557157:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587200.557176:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf080f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309994368:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557244:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587200.557257:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309994880:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557277:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587200.557295:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309995392:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557314:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587200.557350:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309994752 00000100:00100000:0.0:1788587200.557354:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309994752 00000100:00100000:0.0:1788587200.557383:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309995264 00000100:00100000:0.0:1788587200.557386:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309995264 00000100:00100000:0.0:1788587200.557397:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309994880 00000100:00100000:0.0:1788587200.557400:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309994880 00000100:00100000:0.0:1788587200.557410:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309995392 00000100:00100000:0.0:1788587200.557412:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309995392 00000100:00100000:0.0:1788587200.557425:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788587200.557431:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309994752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557478:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309994752:12345-0@lo:400:kworker.0 Request processed in 47us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587200.557485:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788587200.557500:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788587200.557507:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309995264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557532:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469309995264:12345-0@lo:400:kworker.0 Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587200.557537:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788587200.557547:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788587200.557553:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309994880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557577:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309994880:12345-0@lo:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587200.557582:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788587200.557593:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788587200.557599:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309995392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557623:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309995392:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587200.557639:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1788587200.557663:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587200.557666:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587200.557692:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309994880:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557701:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309995392:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557709:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309994752:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.557717:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309995264:0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.558033:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf2c3f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309994112:12345-0@lo:400:kworker.0 Request processed in 1147us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587200.558040:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788587200.558292:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309994112:0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.558977:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309994368 00000100:00100000:3.0:1788587200.558983:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309994368 00000100:00100000:3.0:1788587200.559008:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788587200.559026:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309994368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.559067:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309994368:12345-0@lo:400:kworker.0 Request processed in 52us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587200.559074:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788587200.559092:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309994624 00000100:00100000:3.0:1788587200.559096:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309994624 00000100:00100000:3.0:1788587200.559167:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309995136 00000100:00100000:3.0:1788587200.559171:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309995136 00000100:00100000:0.0:1788587200.559238:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309994368:0@lo:400:kworker.0 00000100:00080000:1.0:1788587200.559650:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587200.562491:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309993984 00000100:00100000:3.0:1788587200.562505:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309993984 00000100:00100000:3.0:1788587200.562522:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309994496 00000100:00100000:3.0:1788587200.562525:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309994496 00000100:00100000:0.0:1788587200.562636:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309995008 00000100:00100000:0.0:1788587200.562642:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309995008 00000100:00100000:2.0:1788587200.562682:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309994240 00000100:00100000:2.0:1788587200.562686:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309994240 00000100:00100000:2.0:1788587200.562709:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788587200.562717:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309994624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587200.562825:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309994624:12345-0@lo:400:kworker.0 Request processed in 108us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587200.562832:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788587200.562849:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788587200.562854:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309995136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587200.562879:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309995136:12345-0@lo:400:kworker.0 Request processed in 26us (6217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587200.562885:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788587200.562902:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788587200.562908:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309993984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587200.562930:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469309993984:12345-0@lo:400:kworker.0 Request processed in 23us (6225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587200.562935:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788587200.562943:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788587200.562948:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309994240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587200.562973:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469309994240:12345-0@lo:400:kworker.0 Request processed in 25us (5931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587200.562978:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788587200.563030:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469309993984:0@lo:400:kworker.0 00010000:00080000:2.0:1788587200.563044:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf080f5880 x1875469309994624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587200.563072:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309994624:0@lo:400:kworker.0 00010000:00080000:2.0:1788587200.563083:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a51f80 x1875469309995136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587200.563091:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309995136:0@lo:400:kworker.0 00000100:00080000:1.0:1788587200.571656:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587200.572197:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788587200.572212:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309994496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.572317:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469309994496:12345-0@lo:400:kworker.0 Request processed in 111us (15581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587200.572325:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788587200.572352:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309993856 00000100:00100000:3.0:1788587200.572360:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309993856 00000100:00100000:3.0:1788587200.572401:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788587200.572407:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309993856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587200.572440:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309993856:12345-0@lo:400:kworker.0 Request processed in 33us (15281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587200.572446:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788587200.572747:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469309994496:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.586278:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309993856:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.586299:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf080f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469309994240:0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.586377:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788587200.586386:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309995008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587200.586519:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469309995008:12345-0@lo:400:kworker.0 Request processed in 135us (29754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587200.586527:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788587200.589075:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469309995008:0@lo:400:kworker.0 00010000:00010000:3.0:1788587200.958893:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587201.070185:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309995520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587201.070262:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587201.070320:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587201.070328:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309995648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587201.070352:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587201.070385:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309995520 00000100:00100000:1.0:1788587201.070392:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309995520 00000100:00100000:1.0:1788587201.070427:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309995648 00000100:00100000:1.0:1788587201.070430:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309995648 00000100:00100000:1.0:1788587201.070445:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788587201.070453:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309995520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587201.070486:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587201.070533:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309995520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587201.070540:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788587201.070558:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788587201.070565:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309995648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587201.070575:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587201.070598:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309995648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587201.070617:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788587201.070665:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309995648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587201.070679:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309995520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587201.682905:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587201.682947:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587201.682981:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587201.683024:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587201.683043:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587201.683059:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587201.683083:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587201.683111:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292122624 00000100:00100000:1.0:1788587201.683121:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292122624 00000100:00100000:1.0:1788587201.683175:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292122496 00000100:00100000:1.0:1788587201.683178:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292122496 00000100:00100000:1.0:1788587201.683201:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 172 00000100:00100000:1.0:1788587201.683211:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292122624:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587201.683293:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292122624:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 82us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587201.683301:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 172 00000100:00100000:1.0:1788587201.683319:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 173 00000100:00100000:1.0:1788587201.683326:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2411:x1875469292122496:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587201.683351:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+7:2411:x1875469292122496:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587201.683357:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 173 00000100:00100000:0.0:1788587201.683752:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292122112 00000100:00100000:0.0:1788587201.683757:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292122112 00000100:00100000:0.0:1788587201.683817:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 393 00000100:00100000:0.0:1788587201.683825:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292122112:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587201.683861:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf05329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2411:x1875469292122112:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 38us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587201.683878:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 393 00000100:00100000:0.0:1788587201.683908:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292122368 00000100:00100000:0.0:1788587201.683913:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292122368 00000100:00100000:0.0:1788587201.683936:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292122880 00000100:00100000:0.0:1788587201.683938:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292122880 00000100:00100000:0.0:1788587201.683950:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292122240 00000100:00100000:0.0:1788587201.683953:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292122240 00000100:00100000:0.0:1788587201.683963:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292122752 00000100:00100000:0.0:1788587201.683965:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292122752 00000100:00100000:0.0:1788587201.683977:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 338 00000100:00100000:0.0:1788587201.683984:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292122368:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587201.684025:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+5:2411:x1875469292122368:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 41us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587201.684031:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 338 00000100:00100000:0.0:1788587201.684044:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 339 00000100:00100000:0.0:1788587201.684050:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292122880:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587201.684072:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2411:x1875469292122880:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587201.684078:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 339 00000100:00100000:0.0:1788587201.684089:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 340 00000100:00100000:0.0:1788587201.684094:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:2411:x1875469292122240:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587201.684116:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:2411:x1875469292122240:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 21us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587201.684122:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 340 00000100:00100000:0.0:1788587201.684133:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 341 00000100:00100000:0.0:1788587201.684146:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2411:x1875469292122752:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587201.684171:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2411:x1875469292122752:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 25us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587201.684176:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 341 00000100:00080000:0.0:1788587201.684192:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587201.684195:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587201.684198:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587201.684200:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788587201.963217:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587202.091766:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309995776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587202.091861:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587202.092123:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309995776 00000100:00100000:3.0:1788587202.092132:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309995776 00000100:00100000:3.0:1788587202.092188:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788587202.092214:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309995776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587202.092254:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788587202.092349:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587202.092948:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309996032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587202.093117:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309995904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587202.096359:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587202.096487:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587202.096575:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309995904 00000100:00100000:2.0:1788587202.096586:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309995904 00000100:00100000:2.0:1788587202.096639:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788587202.096660:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309995904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587202.096684:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587202.096732:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309995904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587202.096738:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788587202.096825:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587202.096891:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309995904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587202.096993:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309995776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4796us (5131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587202.097010:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788587202.097082:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309995776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587202.097298:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309996032 00000100:00100000:0.0:1788587202.097303:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309996032 00000100:00100000:0.0:1788587202.097346:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788587202.097353:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309996032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587202.097385:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587202.097435:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309996032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587202.097442:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788587202.097521:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309996032:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788587202.155068:0:13326:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587202.155077:0:13326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587202.155510:0:13326:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788587202.155525:0:13326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587202.603748:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309996160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587202.603834:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587202.604188:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309996160 00000100:00100000:0.0:1788587202.604196:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309996160 00000100:00100000:0.0:1788587202.604392:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788587202.604402:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309996160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587202.605335:0:6478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1788587202.605417:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469309996160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1016us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587202.605577:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469309996160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587202.605774:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000040:00080000:0.0:1788587202.670407:0:13329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587202.987166:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587203.509456:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587203.509544:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292123136 00000100:00100000:0.0:1788587203.509556:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292123136 00000100:00100000:0.0:1788587203.509634:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:0.0:1788587203.509648:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+18:13330:x1875469292123136:12345-192.168.203.14@tcp:35:umount.0 00000100:00080000:1.0:1788587203.509895:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587203.509979:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+19:13330:x1875469292123136:12345-192.168.203.14@tcp:35:umount.0 Request processed in 333us (532us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788587203.509987:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:0.0:1788587203.514213:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587203.514305:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292123392 00000100:00100000:3.0:1788587203.514316:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292123392 00000100:00100000:3.0:1788587203.514377:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:3.0:1788587203.514389:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+19:13330:x1875469292123392:12345-192.168.203.14@tcp:35:umount.0 00000100:00100000:3.0:1788587203.515367:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12266002-a8db-4050-aa6c-b9db12e6128d+20:13330:x1875469292123392:12345-192.168.203.14@tcp:35:umount.0 Request processed in 976us (1161us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788587203.515377:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:3.0:1788587203.518366:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587203.518474:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292123648 00000100:00100000:2.0:1788587203.518484:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292123648 00000100:00100000:2.0:1788587203.518660:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:2.0:1788587203.518670:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0365f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+20:13330:x1875469292123648:12345-192.168.203.14@tcp:35:umount.0 00000100:00100000:2.0:1788587203.519345:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0365f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12266002-a8db-4050-aa6c-b9db12e6128d+21:13330:x1875469292123648:12345-192.168.203.14@tcp:35:umount.0 Request processed in 674us (986us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788587203.519368:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:1.0:1788587203.522247:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587203.522613:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292123904 00000100:00100000:0.0:1788587203.522622:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292123904 00000100:00100000:0.0:1788587203.522709:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:0.0:1788587203.522718:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:13330:x1875469292123904:12345-192.168.203.14@tcp:35:umount.0 00000100:00100000:0.0:1788587203.523103:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12266002-a8db-4050-aa6c-b9db12e6128d+22:13330:x1875469292123904:12345-192.168.203.14@tcp:35:umount.0 Request processed in 383us (864us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788587203.523111:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:0.0:1788587203.526293:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587203.526336:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587203.526436:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587203.527082:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587203.527124:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292124416 00000100:00100000:0.0:1788587203.527134:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292124416 00000100:00100000:0.0:1788587203.527197:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:0.0:1788587203.527208:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+5:2408:x1875469292124416:12345-192.168.203.14@tcp:9:umount.0 00000020:00000080:0.0:1788587203.527258:0:8100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343bf7 00000100:00080000:0.0:1788587203.527267:0:8100:0:(import.c:65:import_set_state_nolock()) ffff8cbe05da8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587203.527305:0:8100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788587203.527585:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12266002-a8db-4050-aa6c-b9db12e6128d+2:2408:x1875469292124416:12345-192.168.203.14@tcp:9:umount.0 Request processed in 377us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587203.527593:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00080000:0.0:1788587203.527627:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788587203.527642:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587203.528115:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292124032 00000100:00100000:1.0:1788587203.528122:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292124032 00000100:00100000:1.0:1788587203.528162:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292124288 00000100:00100000:1.0:1788587203.528165:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292124288 00000100:00100000:1.0:1788587203.528179:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292124160 00000100:00100000:1.0:1788587203.528181:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292124160 00000100:00100000:1.0:1788587203.528199:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:1.0:1788587203.528218:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf06302450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4b0c77f-670d-4698-a42c-a862f5ca1366+15:2409:x1875469292124032:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587203.528230:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587203.528249:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63438d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5711 expref: 15 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587203.528266:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587203.528302:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf06302450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4b0c77f-670d-4698-a42c-a862f5ca1366+14:2409:x1875469292124032:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 96us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587203.528309:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:1.0:1788587203.528350:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:1.0:1788587203.528365:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4b0c77f-670d-4698-a42c-a862f5ca1366+13:2409:x1875469292124288:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587203.528373:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587203.528382:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf00031600/0x419e1ae1f6343af4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ea expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587203.528391:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587203.528408:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:2409:x1875469292124288:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 44us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587203.528413:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:1.0:1788587203.528425:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:1.0:1788587203.528431:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:2409:x1875469292124160:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587203.528438:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587203.528446:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf00031c00/0x419e1ae1f634381c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd56d2 expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587203.528453:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587203.528468:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2409:x1875469292124160:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 38us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587203.528473:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:0.0:1788587203.531104:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587203.531192:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292124800 00000100:00100000:1.0:1788587203.531202:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292124800 00000100:00080000:0.0:1788587203.531240:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587203.531266:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:1.0:1788587203.531277:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+7:2408:x1875469292124800:12345-192.168.203.14@tcp:9:umount.0 00000020:00000080:1.0:1788587203.531312:0:8101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343e58 00000020:00010000:1.0:1788587203.531320:0:8101:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbf12ef5000: total 0 00000100:00080000:1.0:1788587203.531324:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdae000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788587203.531361:0:8117:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbf12ef5000: total 0 00000001:00000004:1.0:1788587203.531365:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:3.0:1788587203.531398:0:8117:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbf12ef5000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788587203.531461:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f63448a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b8d expref: 6 pid: 8100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587203.531500:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f63441fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59bf expref: 5 pid: 8100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587203.531666:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12266002-a8db-4050-aa6c-b9db12e6128d+4:2408:x1875469292124800:12345-192.168.203.14@tcp:9:umount.0 Request processed in 391us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587203.531676:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 81 00010000:00010000:3.0:1788587203.531774:0:8117:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbf12ef5000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788587203.531787:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587203.531789:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587203.531854:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587203.540392:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587203.540753:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292125824 00000100:00100000:2.0:1788587203.540764:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292125824 00000100:00100000:2.0:1788587203.540844:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 252 00000100:00100000:2.0:1788587203.540855:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+22:2408:x1875469292125824:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:2.0:1788587203.540887:0:6472:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634382a 00000020:00010000:2.0:1788587203.540902:0:6472:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbf3bdac800: total 0 00000100:00080000:2.0:1788587203.540907:0:6472:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdaa000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587203.540931:0:6472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1788587203.541301:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12266002-a8db-4050-aa6c-b9db12e6128d+21:2408:x1875469292125824:12345-192.168.203.14@tcp:39:umount.0 Request processed in 447us (917us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788587203.541309:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 252 00000020:00010000:0.0:1788587203.541952:0:8116:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbf3bdac800: total 0 00010000:00010000:0.0:1788587203.542236:0:8116:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbf3bdac800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788587203.542269:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:0.0:1788587203.542273:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587203.542283:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344280 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59e2 expref: 20 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.542303:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587203.542306:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587203.542310:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062af200/0x419e1ae1f63440dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5972 expref: 19 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.542323:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587203.542326:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587203.542330:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf01483600/0x419e1ae1f6343bcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5814 expref: 18 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.542366:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587203.542370:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587203.542374:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482c00/0x419e1ae1f6344781 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b40 expref: 17 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.542387:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:0.0:1788587203.542389:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587203.542393:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3200/0x419e1ae1f6344264 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59db expref: 16 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.542406:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf03491200) 00010000:00010000:0.0:1788587203.542408:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587203.542413:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044000/0x419e1ae1f6343b72 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57ff expref: 15 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.542430:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587203.542433:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587203.542436:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27400/0x419e1ae1f6344861 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b78 expref: 14 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.542447:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cbf2c8be700) 00010000:00010000:0.0:1788587203.542449:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788587203.542453:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26e00/0x419e1ae1f634488b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b86 expref: 13 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.542469:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587203.542471:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587203.542482:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe062ae000/0x419e1ae1f63441bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59aa expref: 12 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.543142:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587203.543145:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788587203.543152:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63441e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd59b8 expref: 11 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.543172:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cbf07fc8500) 00010000:00010000:0.0:1788587203.543175:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587203.543179:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2200/0x419e1ae1f634455f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ab4 expref: 10 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.543190:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cbf2c8bea00) 00010000:00010000:0.0:1788587203.543191:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587203.543194:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6343eba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd58e6 expref: 9 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.543203:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf03491300) 00010000:00010000:0.0:1788587203.543204:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587203.543206:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6343b56 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57f8 expref: 8 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587203.543215:0:8116:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbf3bdac800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788587203.543230:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587203.543232:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587203.543233:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587203.552607:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587203.552742:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292125952 00000100:00100000:2.0:1788587203.553041:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292125952 00000100:00100000:2.0:1788587203.553150:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 253 00000100:00100000:2.0:1788587203.553161:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+5:2408:x1875469292125952:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:2.0:1788587203.553196:0:8126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343831 00000100:00080000:2.0:1788587203.553212:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdd7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587203.553242:0:8126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1788587203.553561:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587203.553690:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12266002-a8db-4050-aa6c-b9db12e6128d+3:2408:x1875469292125952:12345-192.168.203.14@tcp:39:umount.0 Request processed in 529us (1091us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788587203.553699:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 253 00010000:00010000:1.0:1788587203.553731:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587204.011039:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587205.035052:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587205.394529:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587205.394585:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587205.394619:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587205.394784:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292126080 00000100:00100000:3.0:1788587205.394815:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292126080 00000100:00100000:3.0:1788587205.394887:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292126336 00000100:00100000:3.0:1788587205.394891:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292126336 00000100:00100000:3.0:1788587205.394904:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292126208 00000100:00100000:3.0:1788587205.394907:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292126208 00000100:00100000:3.0:1788587205.394922:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:3.0:1788587205.394932:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+12:2410:x1875469292126080:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587205.394947:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587205.394966:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634392d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5726 expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587205.394994:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587205.395046:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+11:2410:x1875469292126080:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 115us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587205.395053:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:3.0:1788587205.395071:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:3.0:1788587205.395092:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+10:2410:x1875469292126336:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587205.395102:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587205.395111:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6343aed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd57e3 expref: 10 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587205.395121:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587205.395139:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+9:2410:x1875469292126336:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 49us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587205.395145:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:3.0:1788587205.395158:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:3.0:1788587205.395163:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+8:2410:x1875469292126208:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587205.395171:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587205.395179:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37105600/0x419e1ae1f6343934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5757 expref: 8 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587205.395187:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587205.395202:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4b0c77f-670d-4698-a42c-a862f5ca1366+7:2410:x1875469292126208:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587205.395207:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:1.0:1788587205.433873:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587205.434031:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292126592 00000100:00100000:2.0:1788587205.434041:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292126592 00000100:00100000:2.0:1788587205.434116:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 254 00000100:00100000:2.0:1788587205.434126:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+6:2408:x1875469292126592:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:2.0:1788587205.434177:0:6474:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343942 00000020:00010000:2.0:1788587205.434186:0:6474:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbe04fd0000: total 0 00000100:00080000:2.0:1788587205.434190:0:6474:0:(import.c:65:import_set_state_nolock()) ffff8cbe04fd6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587205.434232:0:6474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788587205.434665:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2408:x1875469292126592:12345-192.168.203.14@tcp:39:umount.0 Request processed in 540us (800us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788587205.434674:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 254 00000020:00010000:1.0:1788587205.435294:0:8116:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbe04fd0000: total 0 00010000:00010000:1.0:1788587205.435336:0:8116:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbe04fd0000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788587205.435367:0:8116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:1.0:1788587205.435371:0:8116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587205.435379:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27c00/0x419e1ae1f63448ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5b94 expref: 4 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587205.435463:0:8116:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbe04fd0000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788587205.435475:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587205.435478:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587205.435479:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587205.435535:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587205.475103:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587205.475209:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292126720 00000100:00100000:2.0:1788587205.475219:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292126720 00000100:00100000:2.0:1788587205.475289:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 255 00000100:00100000:2.0:1788587205.475300:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+5:2408:x1875469292126720:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:2.0:1788587205.475339:0:6472:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343949 00000100:00080000:2.0:1788587205.475354:0:6472:0:(import.c:65:import_set_state_nolock()) ffff8cbe04fd7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587205.475382:0:6472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:0.0:1788587205.475509:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587205.475840:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bb361c2-21de-4228-8a96-92f24b49adc6+3:2408:x1875469292126720:12345-192.168.203.14@tcp:39:umount.0 Request processed in 541us (745us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788587205.475848:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 255 00010000:00010000:1.0:1788587205.476498:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587205.521565:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587205.521729:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292126976 00000100:00100000:0.0:1788587205.521740:0:6464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292126976 00000100:00100000:0.0:1788587205.521838:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 394 00000100:00100000:0.0:1788587205.521848:0:6464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+7:2408:x1875469292126976:12345-192.168.203.14@tcp:251:umount.0 00000020:00000080:0.0:1788587205.521890:0:6464:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343807 00000020:00010000:0.0:1788587205.521907:0:6464:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbf3bdad800: total 0 00000100:00080000:0.0:1788587205.521913:0:6464:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bda9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788587205.521991:0:6464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4b0c77f-670d-4698-a42c-a862f5ca1366+3:2408:x1875469292126976:12345-192.168.203.14@tcp:251:umount.0 Request processed in 136us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.521999:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 394 00000020:00010000:2.0:1788587205.522433:0:6461:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbf3bdad800: total 0 00010000:00010000:2.0:1788587205.522439:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587205.522484:0:6461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbf3bdad800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788587205.522517:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044600/0x419e1ae1f63438e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5718 expref: 2 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587205.522531:0:6461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbf3bdad800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788587205.522539:0:6461:0:(genops.c:885:class_export_put()) final put ffff8cbf3bdad800/b4b0c77f-670d-4698-a42c-a862f5ca1366 00010000:00010000:2.0:1788587205.522556:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587205.522558:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587205.522573:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587205.522663:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3bdad800/b4b0c77f-670d-4698-a42c-a862f5ca1366 for MGS 00000020:00000080:3.0:1788587205.522750:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3bda9800 for MGS 00000100:00100000:0.0:1788587205.675229:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309996672:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675296:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587205.675351:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309997184:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675372:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587205.675387:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309997696:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675402:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587205.675422:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788587205.675426:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309996544:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675445:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587205.675460:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309997056:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675490:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587205.675505:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309997568:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675520:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587205.675545:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309997184 00000100:00100000:0.0:1788587205.675552:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309997184 00000100:00100000:0.0:1788587205.675594:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309997696 00000100:00100000:0.0:1788587205.675596:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309997696 00000100:00100000:0.0:1788587205.675612:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788587205.675621:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309997184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675663:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309997184:12345-0@lo:400:kworker.0 Request processed in 44us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.675671:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788587205.675686:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788587205.675691:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309997696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675714:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309997696:12345-0@lo:400:kworker.0 Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.675736:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788587205.675752:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309996544 00000100:00100000:0.0:1788587205.675755:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309996544 00000100:00100000:0.0:1788587205.675776:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788587205.675781:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309996544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.675835:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469309996544:12345-0@lo:400:kworker.0 Request processed in 52us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.675841:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788587205.675857:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309996672 00000100:00100000:0.0:1788587205.676046:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309996672 00000100:00100000:0.0:1788587205.676071:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309997056 00000100:00100000:0.0:1788587205.676080:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309997056 00000100:00100000:0.0:1788587205.676098:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309997568 00000100:00100000:0.0:1788587205.676100:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309997568 00000100:00100000:0.0:1788587205.676113:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788587205.676118:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309996672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.676148:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469309996672:12345-0@lo:400:kworker.0 Request processed in 30us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.676154:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788587205.676164:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788587205.676169:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309997056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.676204:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469309997056:12345-0@lo:400:kworker.0 Request processed in 35us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.676210:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788587205.676220:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788587205.676226:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309997568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.676250:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469309997568:12345-0@lo:400:kworker.0 Request processed in 25us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.676255:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:0.0:1788587205.676276:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587205.676280:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587205.676282:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587205.676304:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309996288:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.676309:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309996544:0@lo:400:kworker.0 00010000:00080000:0.0:1788587205.676320:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf0363a680 x1875469309997056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587205.676330:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469309997056:0@lo:400:kworker.0 00000100:00100000:2.0:1788587205.676336:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788587205.676338:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf03638000 x1875469309997568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587205.676352:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469309997568:0@lo:400:kworker.0 00000100:00100000:2.0:1788587205.676361:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309996800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.676363:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469309996672:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.676371:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309997184:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.676380:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469309997696:0@lo:400:kworker.0 00000100:00100000:2.0:1788587205.676381:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587205.676395:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309997312:0@lo:400:kworker.0 00000100:00100000:2.0:1788587205.676413:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587205.676427:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309997824:0@lo:400:kworker.0 00000100:00100000:2.0:1788587205.676445:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587205.676483:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309996288 00000100:00100000:3.0:1788587205.676487:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309996288 00000100:00100000:1.0:1788587205.676511:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309996416:0@lo:400:kworker.0 00000100:00100000:3.0:1788587205.676513:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788587205.676520:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309996288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587205.676539:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587205.676545:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0532ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309996288:12345-0@lo:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587205.676556:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788587205.676557:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309996928:0@lo:400:kworker.0 00000100:00100000:1.0:1788587205.676574:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587205.676582:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309996416 00000100:00100000:3.0:1788587205.676585:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309996416 00000100:00100000:1.0:1788587205.676587:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309997440:0@lo:400:kworker.0 00000100:00100000:3.0:1788587205.676598:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309996928 00000100:00100000:3.0:1788587205.676600:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309996928 00000100:00100000:1.0:1788587205.676604:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587205.676616:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309997440 00000100:00100000:3.0:1788587205.676619:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309997440 00000100:00100000:3.0:1788587205.676631:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788587205.676637:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309996416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587205.676651:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788587205.676659:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309996928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587205.676668:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469309996416:12345-0@lo:400:kworker.0 Request processed in 31us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587205.676673:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788587205.676684:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788587205.676685:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469309996928:12345-0@lo:400:kworker.0 Request processed in 28us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587205.676689:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309997440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587205.676698:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788587205.676711:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469309997440:12345-0@lo:400:kworker.0 Request processed in 21us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587205.676716:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788587205.676747:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469309996416:0@lo:400:kworker.0 00000100:00100000:3.0:1788587205.676749:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309996800 00000100:00100000:3.0:1788587205.676752:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309996800 00000100:00100000:1.0:1788587205.676757:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469309996928:0@lo:400:kworker.0 00000100:00100000:1.0:1788587205.676765:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469309997440:0@lo:400:kworker.0 00000100:00100000:3.0:1788587205.676771:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788587205.676776:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309996800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788587205.676781:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587205.676821:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309996800:12345-0@lo:400:kworker.0 Request processed in 44us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587205.676827:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788587205.680398:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309996288:0@lo:400:kworker.0 00000100:00100000:2.0:1788587205.680416:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309996800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.682369:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309997312 00000100:00100000:0.0:1788587205.682383:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309997312 00000100:00100000:0.0:1788587205.682467:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309997824 00000100:00100000:0.0:1788587205.682470:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309997824 00000100:00100000:0.0:1788587205.682489:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788587205.682498:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309997312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.682584:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309997312:12345-0@lo:400:kworker.0 Request processed in 86us (6169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.682591:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788587205.682606:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788587205.682612:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309997824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587205.682637:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469309997824:12345-0@lo:400:kworker.0 Request processed in 26us (6191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587205.682642:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:2.0:1788587205.682786:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587205.682790:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587205.682851:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309997312:0@lo:400:kworker.0 00000100:00100000:2.0:1788587205.682935:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469309997824:0@lo:400:kworker.0 00010000:00010000:1.0:1788587206.062078:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587206.187256:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309997952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587206.187322:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587206.187395:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309997952 00000100:00100000:1.0:1788587206.187403:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309997952 00000100:00100000:1.0:1788587206.187447:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788587206.187457:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309997952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587206.187493:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587206.187536:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469309997952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587206.187543:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788587206.187852:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469309997952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587206.188342:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309998080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587206.188378:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587206.190179:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309998080 00000100:00100000:3.0:1788587206.190204:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309998080 00000100:00100000:3.0:1788587206.190259:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587206.190284:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309998080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587206.190307:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587206.190377:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469309998080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587206.190384:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587206.190431:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469309998080:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788587206.266619:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7bb361c2-21de-4228-8a96-92f24b49adc6 00000001:00080000:1.0:1788587206.266639:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788587206.266645:0:7270:0:(genops.c:885:class_export_put()) final put ffff8cbe04fd3800/7bb361c2-21de-4228-8a96-92f24b49adc6 00000020:00000080:0.0:1788587206.266726:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe04fd3800/7bb361c2-21de-4228-8a96-92f24b49adc6 for lustre-MDT0001 00000001:00100000:1.0:1788587206.266815:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:0.0:1788587206.266834:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe04fd7800 for lustre-MDT0001 00000001:00080000:1.0:1788587206.266878:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1788587206.266888:0:7270:0:(genops.c:885:class_export_put()) final put ffff8cbf3bdd4800/12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:2.0:1788587206.267027:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3bdd4800/12266002-a8db-4050-aa6c-b9db12e6128d for lustre-MDT0001 00000020:00000080:2.0:1788587206.267070:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3bdd7800 for lustre-MDT0001 00000001:00100000:2.0:1788587206.272422:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:2.0:1788587206.272432:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbe05da9000/12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:2.0:1788587206.272458:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05da9000/12266002-a8db-4050-aa6c-b9db12e6128d for lustre-OST0001 00000020:00000080:2.0:1788587206.272496:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe05da8000 for lustre-OST0001 00010000:00010000:1.0:1788587207.089374:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587207.135072:0:14774:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788587207.161340:0:14774:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788587207.161391:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.161407:0:14774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.161416:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.161424:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.161453:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788587207.161459:0:14774:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788587207.161487:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587207.161492:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788587207.161498:0:14774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587207.161523:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbf3b87f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788587207.161571:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469309998208:0@lo:39:umount.0 00010000:00010000:3.0:1788587207.161642:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587207.161649:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.161656:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587207.161660:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.161668:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587207.161674:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587207.161679:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788587207.161681:0:6460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788587207.161684:0:6460:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788587207.161712:0:6460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.161718:0:6460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587207.161757:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.161782:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc800/0x419e1ae1f63438af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438b6 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587207.161785:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.161820:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309998336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587207.161828:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587207.161831:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587207.161833:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587207.161991:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587207.162126:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309998336 00000100:00100000:3.0:1788587207.162133:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309998336 00000100:00100000:3.0:1788587207.162190:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587207.162199:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+24:3473:x1875469309998336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587207.162212:0:6457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587207.162228:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044400/0x419e1ae1f63438b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63438af expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.162242:0:6457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587207.162286:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5a87955-d364-4ecd-b672-456c35aa135f+23:3473:x1875469309998336:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.162294:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587207.162465:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309998336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587207.167569:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309998208 00000100:00100000:1.0:1788587207.167584:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309998208 00000100:00100000:0.0:1788587207.167922:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788587207.167934:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1875469309998208:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788587207.168014:0:8126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634341e 00000100:00080000:0.0:1788587207.168024:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8cbf39084000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788587207.168152:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3471:x1875469309998208:12345-0@lo:39:umount.0 Request processed in 220us (6369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.168159:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000020:00000080:0.0:1788587207.168169:0:8126:0:(genops.c:885:class_export_put()) final put ffff8cbf0364f800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788587207.168357:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587207.168545:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3b87f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788587207.168567:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469309998208:0@lo:39:umount.0 00000100:00080000:0.0:1788587207.168692:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587207.168696:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788587207.168700:0:14774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587207.169639:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0364f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587207.169702:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf39084000 for lustre-MDT0000 00010000:00010000:2.0:1788587207.170482:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170496:0:14774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170504:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170510:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170537:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587207.170544:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170551:0:14774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170558:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170564:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170583:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587207.170589:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170596:0:14774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170617:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170623:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170641:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788587207.170647:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170653:0:14774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170660:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170666:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170680:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788587207.170683:0:14774:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788587207.170709:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788587207.170715:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170722:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587207.170942:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.170963:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587207.170985:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587207.170991:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587207.170994:0:6461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788587207.170996:0:6461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788587207.171029:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171035:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587207.171056:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171064:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f63438bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438c4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171075:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587207.171078:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171084:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf01483c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587207.171087:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171094:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587207.171111:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587207.171117:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587207.171119:0:6461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788587207.171120:0:6461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788587207.171134:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171139:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587207.171146:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171152:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf01483c00/0x419e1ae1f63437ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63437c1 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171161:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587207.171164:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171169:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587207.171171:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171178:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587207.171184:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587207.171199:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788587207.171202:0:6461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788587207.171203:0:6461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788587207.171217:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171223:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587207.171237:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171244:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6343b25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343b2c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171253:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587207.171256:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171261:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587207.171263:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171269:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587207.171276:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587207.171281:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587207.171283:0:6461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788587207.171285:0:6461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788587207.171304:0:6461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171311:0:6461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587207.171316:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171322:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482e00/0x419e1ae1f634337d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343384 expref: -99 pid: 6453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171331:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587207.171332:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587207.171334:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587207.171351:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309998464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587207.171416:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587207.171458:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587207.171464:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309998592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587207.171488:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587207.171518:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309998464 00000100:00100000:2.0:1788587207.171525:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309998464 00000100:00100000:2.0:1788587207.171561:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309998592 00000100:00100000:2.0:1788587207.171564:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309998592 00000100:00100000:2.0:1788587207.171577:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587207.171584:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf06303c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+24:3474:x1875469309998464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587207.171596:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587207.171609:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f63438c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63438bd expref: 24 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.171622:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587207.171626:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587207.171641:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309998848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587207.171657:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf06303c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+23:3474:x1875469309998464:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.171671:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587207.171679:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.171713:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587207.171720:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309998848 00000100:00100000:0.0:1788587207.171722:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309998720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587207.171725:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309998848 00000100:00100000:0.0:1788587207.171746:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.171766:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309998720 00000100:00100000:0.0:1788587207.171781:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309998720 00000100:00100000:0.0:1788587207.171831:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587207.171839:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+23:3474:x1875469309998592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587207.171847:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587207.171857:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf00030c00/0x419e1ae1f63437c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63437ba expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.171867:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587207.171893:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+22:3474:x1875469309998592:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.171906:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587207.171918:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587207.171924:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+21:3473:x1875469309998720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587207.171931:0:6459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587207.171940:0:6459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37104200/0x419e1ae1f6343b2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343b25 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.171948:0:6459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587207.171987:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5a87955-d364-4ecd-b672-456c35aa135f+20:3473:x1875469309998720:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.171992:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587207.172035:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309998720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587207.172334:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587207.172418:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587207.172868:0:14774:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788587207.172873:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788587207.172878:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587207.172884:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788587207.172889:0:14774:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbe03db2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587207.172895:0:14774:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbf3e059000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587207.172909:0:14774:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbf057be000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587207.172913:0:14774:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbf10d7a800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788587207.172920:0:14774:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8cbe04fd0000 7bb361c2-21de-4228-8a96-92f24b49adc6 192.168.203.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587207.172926:0:14774:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8cbf3bdac800 12266002-a8db-4050-aa6c-b9db12e6128d 192.168.203.14@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1788587207.172931:0:14774:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8cbf053a8000) has exports, disconnecting them 00000020:00080000:3.0:1788587207.172935:0:14774:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbe03db2800), last request at 1788587205 00000020:00000080:3.0:1788587207.172942:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634372e 00000100:00080000:3.0:1788587207.172959:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbe03db3000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788587207.173025:0:14774:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe03db2800): rc 0 00000020:00000080:3.0:1788587207.173028:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbe03db2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788587207.173046:0:14774:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbf3e059000), last request at 1788587205 00000020:00000080:3.0:1788587207.173050:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634360f 00000100:00080000:3.0:1788587207.173057:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbf3e058000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788587207.173067:0:14774:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf3e059000): rc 0 00000020:00000080:3.0:1788587207.173069:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf3e059000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788587207.173073:0:14774:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbf057be000), last request at 1788586992 00000020:00000080:3.0:1788587207.173076:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343505 00000100:00080000:3.0:1788587207.173079:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbf057b8800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788587207.173093:0:14774:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf057be000): rc 0 00000020:00000080:3.0:1788587207.173095:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf057be000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788587207.173099:0:14774:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbf10d7a800), last request at 1788586992 00000020:00000080:3.0:1788587207.173102:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63434d4 00000100:00080000:3.0:1788587207.173105:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788587207.173118:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788587207.173126:0:14774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1788587207.173247:0:14774:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf10d7a800): rc 0 00000004:00000080:3.0:1788587207.173260:0:14774:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb625449ffae0 00000100:00080000:3.0:1788587207.173277:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788587207.173280:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788587207.174152:0:14774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788587207.174176:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a381000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788587207.174317:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788587207.174321:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1788587207.174330:0:14774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788587207.174384:0:14774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788587207.174394:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbe05879800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788587207.174400:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788587207.174402:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788587207.174413:0:14774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788587207.174468:0:14774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788587207.174476:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788587207.174503:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cbf053a8000) has no exports 00010000:00010000:1.0:1788587207.174663:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788587207.174673:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03db2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788587207.174732:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3e059000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788587207.174766:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf057be000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788587207.174790:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe03db3000 for lustre-MDT0000 00000020:00000080:1.0:1788587207.174818:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3e058000 for lustre-MDT0000 00000020:00000080:1.0:1788587207.174822:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf057b8800 for lustre-MDT0000 00000100:00100000:1.0:1788587207.174838:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309998976:0@lo:39:umount.0 00000100:00100000:1.0:1788587207.174924:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.174957:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587207.174960:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309999104:0@lo:9:umount.0 00000100:00100000:0.0:1788587207.174989:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1875469309999360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587207.175000:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587207.175028:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309999232:0@lo:9:umount.0 00000100:00100000:1.0:1788587207.175048:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587207.177084:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309998976 00000100:00100000:3.0:1788587207.177111:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309998976 00000100:00100000:3.0:1788587207.177169:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788587207.177180:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1875469309998976:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788587207.177211:0:6477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343560 00000100:00080000:3.0:1788587207.177219:0:6477:0:(import.c:65:import_set_state_nolock()) ffff8cbf11b4e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587207.177242:0:6477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788587207.177642:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3471:x1875469309998976:12345-0@lo:39:umount.0 Request processed in 463us (2720us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788587207.177649:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00010000:3.0:1788587207.177674:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587207.179030:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309998592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587207.179061:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:3474:1875469309998464:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788587207.179504:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a381000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788587207.179512:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309998976:0@lo:39:umount.0 00000100:00100000:2.0:1788587207.180014:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587207.180029:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+20:3473:x1875469309998848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587207.180048:0:6458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587207.180070:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42045200/0x419e1ae1f6343384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f634337d expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.180286:0:6458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587207.180393:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5a87955-d364-4ecd-b672-456c35aa135f+19:3473:x1875469309998848:12345-0@lo:103:ldlm_bl.0 Request processed in 369us (8715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.180402:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788587207.180500:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309998848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587207.180982:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587207.180993:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587207.181514:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309999104 00000100:00100000:0.0:1788587207.181523:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309999104 00000100:00100000:0.0:1788587207.181541:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309999232 00000100:00100000:0.0:1788587207.181544:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309999232 00000100:00100000:0.0:1788587207.181710:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788587207.181722:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1875469309999232:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788587207.181747:0:8100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63437f2 00000100:00080000:0.0:1788587207.181758:0:8100:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdd1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587207.181822:0:8100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:1.0:1788587207.182018:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587207.182189:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3471:x1875469309999232:12345-0@lo:9:umount.0 Request processed in 469us (7137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.182197:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788587207.183901:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587207.183910:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587207.184747:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788587207.184775:0:3471:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788587207.184777:0:3471:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788587207.184784:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309999232:0@lo:9:umount.0 00000100:00100000:0.0:1788587207.186149:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788587207.186163:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1875469309999104:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788587207.186191:0:8101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63436be 00000100:00080000:0.0:1788587207.186200:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbf41760800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587207.186247:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788587207.186472:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3471:x1875469309999104:12345-0@lo:9:umount.0 Request processed in 312us (11470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.186479:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788587207.186575:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe05879800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788587207.186593:0:3471:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788587207.186596:0:3471:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788587207.186600:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469309999104:0@lo:9:umount.0 00010000:00010000:3.0:1788587207.188638:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788587207.193391:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cbf053a8000) has no exports 00000100:00100000:1.0:1788587207.212758:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587207.212780:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309999488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587207.213051:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587207.213100:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309999488 00000100:00100000:1.0:1788587207.213108:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309999488 00000100:00100000:1.0:1788587207.213151:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788587207.213158:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3474:x1875469309999488:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788587207.213166:0:6477:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788587207.213279:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3474:x1875469309999488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (227us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788587207.213286:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:02020000:1.0:1788587207.213323:0:3474:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1788587207.225117:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309999616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587207.225204:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.225340:0:9561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309999616 00000100:00100000:0.0:1788587207.225350:0:9561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309999616 00000100:00100000:0.0:1788587207.225410:0:9561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788587207.225422:0:9561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309999616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587207.225473:0:9561:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587207.226115:0:9561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469309999616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 693us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.226123:0:9561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788587207.226147:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587207.227496:0:3474:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788587207.227503:0:3474:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788587207.227507:0:3474:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788587207.228018:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469309999616:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1788587207.233670:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63433d8 00000020:00000080:3.0:1788587207.233684:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf0879f000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788587207.233706:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788587207.233842:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587207.233854:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587207.233859:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8cbf08718000) has no exports 00000020:00000080:2.0:1788587207.234265:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63433d1 00000020:00000080:2.0:1788587207.234271:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf0879b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788587207.234319:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587207.234326:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788587207.234696:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0879f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788587207.234702:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf0879d800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788587207.234704:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0879d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788587207.234713:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788587207.235343:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0879b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1788587207.247464:0:3474:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587207.247477:0:3474:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1788587207.247487:0:3474:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cbf3bf3e000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587207.248779:0:3474:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf36f28000 x1875469309999744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587207.250377:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469309999744:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788587207.250448:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587207.250501:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469309999744 00000100:00100000:1.0:1788587207.250510:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469309999744 00000100:00100000:1.0:1788587207.250555:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788587207.250563:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469309999744:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788587207.250581:0:6477:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788587207.257087:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469309999744:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 6517us (6632us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587207.257101:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1788587207.257157:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587207.257162:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587207.257167:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469309999744:0@lo:38:ptlrpcd_00_02.0 00000001:00080000:2.0:1788587207.286739:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:2.0:1788587207.286768:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7bb361c2-21de-4228-8a96-92f24b49adc6 00000001:00080000:2.0:1788587207.286774:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788587207.286777:0:6494:0:(genops.c:885:class_export_put()) final put ffff8cbe04fd0000/7bb361c2-21de-4228-8a96-92f24b49adc6 00000001:00100000:2.0:1788587207.286791:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000001:00080000:2.0:1788587207.286813:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000001:00100000:2.0:1788587207.286820:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587207.286822:0:6494:0:(genops.c:885:class_export_put()) final put ffff8cbf10d7a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587207.286830:0:6494:0:(genops.c:885:class_export_put()) final put ffff8cbf3bdac800/12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:2.0:1788587207.286842:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe04fd0000/7bb361c2-21de-4228-8a96-92f24b49adc6 for lustre-MDT0000 00000020:00000080:2.0:1788587207.286895:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10d7a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788587207.286917:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3bdac800/12266002-a8db-4050-aa6c-b9db12e6128d for lustre-MDT0000 00000020:00000080:2.0:1788587207.286944:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe04fd6000 for lustre-MDT0000 00000020:00000080:2.0:1788587207.286950:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf10d7a000 for lustre-MDT0000 00000020:00000080:2.0:1788587207.286953:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3bdaa000 for lustre-MDT0000 00000001:00100000:1.0:1788587207.293238:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587207.293247:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbf41762000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788587207.293273:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:1.0:1788587207.293276:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbf12ef5000/12266002-a8db-4050-aa6c-b9db12e6128d 00000020:00000080:2.0:1788587207.293409:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf41762000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788587207.293454:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf12ef5000/12266002-a8db-4050-aa6c-b9db12e6128d for lustre-OST0000 00000020:00000080:2.0:1788587207.293479:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf41760800 for lustre-OST0000 00000020:00000080:2.0:1788587207.293484:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3bdae000 for lustre-OST0000 00010000:00010000:2.0:1788587208.107412:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587209.132127:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788587209.258924:0:14774:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf04990cc0 - data ffff8cbf3cb29948/ffff8cbf37131400 00000020:01000000:2.0:1788587209.259089:0:14774:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf086c7f60 - data ffff8cbf2fb5d438/ffff8cbf3abb4400 00000001:00000004:2.0:1788587209.280555:0:14774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788587209.390304:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587209.390313:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788587209.390337:0:14774:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8cbf34a50700 x1875469309998976/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788587217 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587209.390363:0:14774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788587209.393073:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587209.393082:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788587209.394459:0:14774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587209.394466:0:14774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788587209.398931:0:8439:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788587209.398948:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788587209.398972:0:8439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788587209.400700:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587209.400707:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788587209.400864:0:14774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587209.400868:0:14774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587209.419280:0:9525:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587209.419289:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788587209.419304:0:9525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788587209.552411:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63433a0 00000020:00000080:2.0:1788587209.552422:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf0539d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788587209.553532:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63433b5 00000020:00000080:2.0:1788587209.553541:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf3abbf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788587209.553547:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788587209.553552:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587209.553559:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587209.553562:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8cbf053acd40) has no exports 00000004:01000000:2.0:1788587209.553717:0:14774:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788587209.553725:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63437eb 00000020:00000080:2.0:1788587209.553728:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf0493a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788587209.553732:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788587209.553735:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587209.553742:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788587209.553745:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8cbf3b88b380) has no exports 00000020:00000080:2.0:1788587209.553750:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63437e4 00000020:00000080:2.0:1788587209.553753:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbe03e1a800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788587209.554116:0:14774:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788587209.554121:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587209.554125:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1788587209.554132:0:14774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587209.554142:0:14774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788587209.554169:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587209.554178:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587209.554182:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63436a9 00000020:00000080:2.0:1788587209.554186:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbe040c4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788587209.554190:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788587209.554193:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587209.554197:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788587209.554200:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8cbe044f3380) has no exports 00000020:00000080:2.0:1788587209.554204:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63436a2 00000020:00000080:2.0:1788587209.554206:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbe0587d800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788587209.554533:0:14774:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788587209.554536:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587209.554539:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1788587209.554542:0:14774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587209.554544:0:14774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788587209.554564:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587209.554569:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788587209.554580:0:14774:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788587209.554584:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343559 00000020:00000080:2.0:1788587209.554588:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf41766000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788587209.554593:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788587209.554596:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587209.554599:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788587209.554601:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cbf062bcd40) has no exports 00000020:00000080:2.0:1788587209.554605:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343552 00000020:00000080:2.0:1788587209.554607:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf0a385000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788587209.555257:0:14774:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788587209.555261:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587209.555264:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788587209.555268:0:14774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788587209.555292:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587209.555305:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587209.555327:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587209.555330:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587209.555357:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63433bc 00000020:00000080:2.0:1788587209.555361:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf3abbc000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788587209.555366:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788587209.555369:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587209.555372:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587209.555374:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8cbf053ab380) has no exports 00000020:00000080:2.0:1788587209.555394:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587209.555396:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788587209.555400:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63433c3 00000020:00000080:2.0:1788587209.555402:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf3abbc800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788587209.555409:0:14774:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf11802800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788587209.555412:0:14774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf11802800 3 00000020:01000004:2.0:1788587209.555415:0:14774:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbf11802800 from lustre-MDT0000 00000020:00000080:2.0:1788587209.555429:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587209.555432:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788587209.555434:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf05399800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788587209.555436:0:14774:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf05399800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788587209.555443:0:14774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788587209.555504:0:14774:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788587209.555507:0:14774:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788587209.555510:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788587209.555512:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587209.555514:0:14774:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788587209.555520:0:14774:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8cbf0364d800 b5a87955-d364-4ecd-b672-456c35aa135f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587209.555526:0:14774:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8cbf062bb380) has exports, disconnecting them 00000020:00080000:2.0:1788587209.555530:0:14774:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cbf0364d800), last request at 1788586976 00000020:00000080:2.0:1788587209.555542:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343361 00000020:00010000:2.0:1788587209.555546:0:14774:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbf0364d800: total 10 00000100:00080000:2.0:1788587209.555550:0:14774:0:(import.c:65:import_set_state_nolock()) ffff8cbf03649800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788587209.555580:0:14774:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf0364d800): rc 0 00000020:00080000:2.0:1788587209.555584:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8cbf062bb380) has no exports 00000100:00100000:2.0:1788587209.555640:0:6467:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cbf0536a800:6467] 2 exiting: rc = 0 00000020:00000080:2.0:1788587209.555716:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0539d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587209.555724:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abbf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788587209.555727:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf03648000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587209.555729:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf03648000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788587209.555733:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587209.555763:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0493a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788587209.555770:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e1a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587209.555777:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe03e1a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788587209.555782:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbe04fd3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587209.555785:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe04fd3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788587209.555788:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:3.0:1788587209.555855:0:6465:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cbf0536ac00:6465] 1 exiting: rc = 0 00000020:00000080:2.0:1788587209.555860:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe040c4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788587209.555869:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe0587d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587209.555875:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe05879800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788587209.555880:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbe040c3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587209.555883:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe040c3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788587209.555889:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587209.555918:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf41766000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788587209.555925:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0a385000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587209.555929:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf0a381000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788587209.555943:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf0a384800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587209.555945:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0a384800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788587209.555949:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00010000:1.0:1788587209.557588:0:8117:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbf0364d800: total 2 00010000:00010000:1.0:1788587209.557642:0:8117:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbf0364d800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788587209.557675:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf00030200/0x419e1ae1f6343b10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343b09 expref: 14 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557696:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01482400/0x419e1ae1f634346b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343464 expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557710:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f6343b02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343afb expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557723:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483200/0x419e1ae1f63438d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63438cb expref: 11 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557732:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cc000/0x419e1ae1f6343862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f634385b expref: 10 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557742:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6343870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343869 expref: 9 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557752:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37105e00/0x419e1ae1f6343b1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343b17 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557776:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01483800/0x419e1ae1f6343782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f634377b expref: 7 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557787:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483600/0x419e1ae1f634388c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343885 expref: 6 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557815:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482800/0x419e1ae1f634387e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343877 expref: 5 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557824:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37105800/0x419e1ae1f63438a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63438a1 expref: 4 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557832:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf01483400/0x419e1ae1f634345d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343456 expref: 3 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557841:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf37104400/0x419e1ae1f634389a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6343893 expref: 2 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587209.557850:0:8117:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbf0364d800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788587209.557863:0:8117:0:(genops.c:885:class_export_put()) final put ffff8cbf0364d800/b5a87955-d364-4ecd-b672-456c35aa135f 00010000:00010000:1.0:1788587209.557884:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587209.557886:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587209.557887:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587209.557920:0:6464:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cbf10463400:6464] 0 exiting: rc = 1 00000020:00000080:2.0:1788587209.560427:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abbc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788587209.560436:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf3abbb800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788587209.560438:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abbb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788587209.560444:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788587209.560467:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abbc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587209.560472:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0364d800/b5a87955-d364-4ecd-b672-456c35aa135f for MGS 00000020:00000080:2.0:1788587209.560496:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf03649800 for MGS 00000100:00100000:0.0:1788587209.568041:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568053:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568058:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568065:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568087:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568093:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568099:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568104:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568111:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568117:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568122:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568128:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568133:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568138:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568144:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568150:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568154:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568159:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568177:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568182:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568187:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568192:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568198:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568203:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568209:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568214:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568220:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568225:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568231:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568235:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568240:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568246:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568251:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568256:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568262:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568267:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568272:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568277:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568282:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568294:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568299:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568304:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568308:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568313:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568318:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568323:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568328:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568333:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568339:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568345:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568351:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568356:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568361:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568366:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568371:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568376:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568381:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568386:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568391:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568395:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568400:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568404:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568410:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587209.568415:0:14774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788587209.569011:0:14774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788587209.569015:0:14774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788587209.578682:0:14774:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf04990d80 - data ffff8cbf3cb29d80/ffff8cbf37130000 00000020:01000000:0.0:1788587209.578845:0:14774:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf0555f060 - data ffff8cbf2fb28360/ffff8cbf03640800 00000020:00000080:0.0:1788587209.579325:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343345 00000020:00000080:0.0:1788587209.579333:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf1095f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788587209.579352:0:14774:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf11802800 from MGS, refs=2 00000020:01000004:0.0:1788587209.579356:0:14774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf11802800 2 00000020:01000004:0.0:1788587209.579359:0:14774:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbf11802800 from MGS 00000020:00000080:0.0:1788587209.579390:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587209.579397:0:14774:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788587209.579399:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf10958000/MGS 00000020:00000080:0.0:1788587209.579402:0:14774:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10958000/MGS for MGS 00000020:01000000:0.0:1788587209.579408:0:14774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788587209.579457:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788587209.579461:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587209.579466:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788587209.579472:0:14774:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cbf3abb9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587209.579477:0:14774:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8cbf0871b380) has exports, disconnecting them 00000020:00080000:0.0:1788587209.579481:0:14774:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cbf3abb9000), last request at 1788586977 00000020:00000080:0.0:1788587209.579484:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343410 00000020:00080000:0.0:1788587209.579493:0:14774:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf3abb9000): rc 0 00000020:00000080:0.0:1788587209.579498:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf3abb9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788587209.580226:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf1095f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788587209.580241:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abb9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788587209.615929:0:14774:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788587209.615938:0:14774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587209.615942:0:14774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788587209.615950:0:14774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587209.616188:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3b87f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788587209.616251:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587209.616259:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788587209.616264:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf3b878000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788587209.616267:0:14774:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b878000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788587209.616273:0:14774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788587209.616377:0:14774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf11802800 1 00000020:00000080:0.0:1788587209.616383:0:14774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343337 00000020:00000080:0.0:1788587209.616389:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf1095b800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788587209.616482:0:14774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788587209.616487:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587209.616492:0:14774:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587209.616496:0:14774:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8cbf062b8000) has no exports 00000020:00000080:1.0:1788587209.616597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf1095b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587209.709529:0:14774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587209.709543:0:14774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788587209.709548:0:14774:0:(genops.c:885:class_export_put()) final put ffff8cbf10959000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788587209.709552:0:14774:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10959000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788587209.709562:0:14774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788587209.709683:0:14774:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbf1095d000 00000020:02000400:2.0:1788587209.710684:0:14774:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788587210.158110:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587210.797382:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309999872:0@lo:400:kworker.0 00000400:00000100:0.0:1788587210.797447:0:3473:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469309999872 offset 0 length 224: 4 00000100:00080000:2.0:1788587210.797522:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587210.797528:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788587210.797531:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587210.797541:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 404 00000100:00080000:2.0:1788587210.797547:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587210.797556:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cbf3bf3e000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587210.797582:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf36f2a680 x1875469310000000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587210.797635:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310000000:0@lo:38:kworker.0 00000100:00100000:1.0:1788587210.798077:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587210.798127:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310000000 00000100:00100000:1.0:1788587210.798133:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310000000 00000100:00100000:1.0:1788587210.798163:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788587210.798170:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310000000:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788587210.798190:0:6478:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788587210.798226:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310000000:12345-0@lo:38:kworker.0 Request processed in 56us (541us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587210.798233:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:1.0:1788587210.798265:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587210.798269:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587210.798273:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310000000:0@lo:38:kworker.0 00000100:00100000:1.0:1788587210.798980:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469310000256:0@lo:400:kworker.0 00000100:00100000:1.0:1788587210.799017:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587210.799042:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587210.799047:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310000128:0@lo:400:kworker.0 00000100:00100000:1.0:1788587210.799062:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587210.799086:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310000256 00000100:00100000:1.0:1788587210.799090:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310000256 00000100:00100000:3.0:1788587210.799104:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310000384:0@lo:400:kworker.0 00000100:00100000:1.0:1788587210.799113:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310000128 00000100:00100000:1.0:1788587210.799117:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310000128 00000100:00100000:1.0:1788587210.799132:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788587210.799138:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3475:x1875469310000256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587210.799145:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788587210.799147:0:6473:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788587210.799186:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3475:x1875469310000256:12345-0@lo:400:kworker.0 Request processed in 47us (168us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788587210.799192:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788587210.799215:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310000384 00000100:00100000:1.0:1788587210.799223:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310000384 00000100:00100000:1.0:1788587210.799246:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788587210.799252:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310000384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587210.799285:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310000384:12345-0@lo:400:kworker.0 Request processed in 34us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587210.799290:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788587210.799299:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788587210.799303:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3475:x1875469310000128:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788587210.799307:0:6473:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788587210.799323:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3475:x1875469310000128:12345-0@lo:400:kworker.0 Request processed in 18us (259us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788587210.799327:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1788587210.799354:0:3475:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788587210.799358:0:3475:0:(import.c:65:import_set_state_nolock()) ffff8cbf062a1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788587210.799362:0:3475:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:3.0:1788587210.799399:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8cbe06896680 x1875469310000384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587210.799412:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310000384:0@lo:400:kworker.0 00000100:00080000:0.0:1788587210.801145:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587210.802587:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310000896:0@lo:400:kworker.0 00000100:00100000:3.0:1788587210.802659:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587210.802695:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587210.802702:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310000512:0@lo:400:kworker.0 00000100:00100000:3.0:1788587210.802734:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587210.802857:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310000896 00000100:00100000:2.0:1788587210.802865:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310000896 00000100:00100000:3.0:1788587210.803007:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469310000640:0@lo:400:kworker.0 00000100:00100000:2.0:1788587210.803037:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310000512 00000100:00100000:2.0:1788587210.803041:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310000512 00000100:00100000:3.0:1788587210.803055:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587210.803066:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788587210.803075:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310000896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587210.803077:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587210.803082:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310000768:0@lo:400:kworker.0 00000100:00100000:3.0:1788587210.803102:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587210.803131:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310000896:12345-0@lo:400:kworker.0 Request processed in 57us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587210.803139:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788587210.803969:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788587210.803996:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310000512:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788587210.804042:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587210.804046:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587210.804057:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310000512:12345-0@lo:400:kworker.0 Request processed in 73us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587210.804063:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788587210.804104:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310000512:0@lo:400:kworker.0 00000100:00100000:3.0:1788587210.804137:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310000896:0@lo:400:kworker.0 00000100:00100000:3.0:1788587210.804168:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310000640 00000100:00100000:3.0:1788587210.804173:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310000640 00000100:00080000:1.0:1788587210.804215:0:3475:0:(import.c:65:import_set_state_nolock()) ffff8cbf062a1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587210.804222:0:3475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1788587210.804227:0:3475:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cbf062a1800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587210.804261:0:3475:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0586e300 x1875469310001024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587210.804290:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310000128:0@lo:400:kworker.0 00000100:00080000:1.0:1788587210.804307:0:3475:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788587210.804311:0:3475:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788587210.804314:0:3475:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788587210.804323:0:3475:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587210.804326:0:3475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 204 00000100:00080000:1.0:1788587210.804330:0:3475:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbe03e1b000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587210.804341:0:3475:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0586ed80 x1875469310001152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587210.804351:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469310000256:0@lo:400:kworker.0 00000100:00100000:2.0:1788587210.804383:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310001024:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788587210.804434:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587210.804457:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310001152:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788587210.804468:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310000768 00000100:00100000:2.0:1788587210.804473:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587210.804474:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310000768 00000100:00100000:1.0:1788587210.804522:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310001024 00000100:00100000:1.0:1788587210.804525:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310001024 00000100:00100000:1.0:1788587210.804532:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310001152 00000100:00100000:1.0:1788587210.804534:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310001152 00000100:00100000:1.0:1788587210.804542:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788587210.804548:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469310000768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587210.804587:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469310000768:12345-0@lo:400:kworker.0 Request processed in 39us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587210.804594:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788587210.804599:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3471:x1875469310001024:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788587210.804607:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00020000:2.0:1788587210.804615:0:8126:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788587210.804623:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788587210.804629:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310001152:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788587210.804641:0:6472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788587210.804646:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3471:x1875469310001024:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 45us (211us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587210.804652:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788587210.804674:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310001152:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 43us (198us total) trans 0 rc -19/-19 00000100:00080000:2.0:1788587210.804677:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf062a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587210.804683:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587210.804687:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788587210.804691:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310001024:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788587210.804704:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587210.804708:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:1.0:1788587210.804708:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587210.804715:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310001152:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788587210.807157:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788587210.807166:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3474:x1875469310000640:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788587210.807175:0:13560:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788587210.807250:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3474:x1875469310000640:12345-0@lo:400:kworker.0 Request processed in 82us (4192us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788587210.807257:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:3.0:1788587210.807300:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8cbe03d9e300 x1875469310000768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587210.807314:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310000768:0@lo:400:kworker.0 00000100:00080000:3.0:1788587210.807327:0:3474:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587210.807332:0:3474:0:(import.c:65:import_set_state_nolock()) ffff8cbf04939800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788587210.807335:0:3474:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788587210.807340:0:3474:0:(import.c:65:import_set_state_nolock()) ffff8cbf04939800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587210.807344:0:3474:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 221 00000100:00080000:3.0:1788587210.807349:0:3474:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbf04939800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587210.807386:0:3474:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34a51c00 x1875469310001280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587210.807424:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469310000640:0@lo:400:kworker.0 00000100:00100000:1.0:1788587210.807759:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310001280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788587210.807825:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587210.809658:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310001280 00000100:00100000:3.0:1788587210.809671:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310001280 00000100:00100000:3.0:1788587210.809714:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788587210.809722:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310001280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788587210.809743:0:6472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788587210.810975:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310001280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 1248us (3144us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587210.810985:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:1.0:1788587210.813071:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf04939800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587210.813086:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587210.813091:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310001280:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788587211.187526:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587211.307204:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587211.307226:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310001408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587211.307291:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587211.313019:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310001408 00000100:00100000:0.0:1788587211.313038:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310001408 00000100:00100000:0.0:1788587211.313099:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788587211.313110:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310001408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587211.313146:0:8104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587211.313237:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310001408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587211.313244:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788587211.316459:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310001408:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788587211.351899:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788587211.351917:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1788587211.351923:0:7270:0:(genops.c:885:class_export_put()) final put ffff8cbf0a382000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587211.351959:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0a382000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788587211.352018:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf11b4e800 for lustre-MDT0001 00000001:00100000:1.0:1788587211.376853:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587211.376863:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbf3bdd0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587211.376892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3bdd0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788587211.376939:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3bdd1000 for lustre-OST0001 00010000:00010000:2.0:1788587212.204133:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587212.332752:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587212.332776:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310001536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587212.332879:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587212.333721:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310001536 00000100:00100000:0.0:1788587212.333733:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310001536 00000100:00100000:0.0:1788587212.333826:0:8103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788587212.333836:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310001536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587212.333870:0:8103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587212.333949:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310001536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587212.333956:0:8103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788587212.334011:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310001536:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788587212.334201:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1788587212.441249:0:14928:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788587212.451162:0:14928:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788587212.451204:0:14928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451218:0:14928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451225:0:14928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451250:0:14928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451266:0:14928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788587212.451271:0:14928:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788587212.451294:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587212.451300:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451306:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cdc00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587212.451310:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451317:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587212.451324:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587212.451330:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587212.451333:0:8117:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788587212.451345:0:8117:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788587212.451384:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451390:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587212.451417:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451424:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cdc00/0x419e1ae1f6343893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f634389a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.451442:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587212.451444:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587212.451446:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587212.451459:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587212.451462:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788587212.451468:0:14928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587212.451473:0:14928:0:(import.c:65:import_set_state_nolock()) ffff8cbf062a1800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788587212.451478:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587212.451480:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788587212.451482:0:14928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788587212.451756:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469310001664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587212.451839:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587212.455082:0:14928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455102:0:14928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455111:0:14928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455119:0:14928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455138:0:14928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587212.455144:0:14928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455152:0:14928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455177:0:14928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455184:0:14928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455209:0:14928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587212.455216:0:14928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455222:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587212.455224:0:14928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455231:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455233:0:14928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455247:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044800 already unused, calling callback (ffffffffc1cf1c20) 00010000:00010000:1.0:1788587212.455250:0:14928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587212.455253:0:8116:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455273:0:8116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455279:0:14928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:3.0:1788587212.455280:0:8116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.455286:0:14928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587212.455303:0:8116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587212.455305:0:14928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587212.455307:0:8116:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00000100:00100000:2.0:1788587212.455310:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310001664 00010000:00010000:1.0:1788587212.455318:0:14928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587212.455322:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310001664 00010000:00010000:3.0:1788587212.455338:0:8116:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455345:0:8116:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587212.455368:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587212.455373:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788587212.455377:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044800/0x419e1ae1f63438a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63438a8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455395:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788587212.455395:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3475:x1875469310001664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587212.455401:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:2.0:1788587212.455405:0:6457:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587212 with bad export cookie 4728246216586179425 00010000:00010000:3.0:1788587212.455412:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587212.455416:0:8116:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455428:0:8116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587212.455435:0:8116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587212.455440:0:8116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788587212.455442:0:8116:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788587212.455444:0:8116:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788587212.455466:0:8116:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455471:0:8116:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587212.455476:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455482:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483000/0x419e1ae1f634377b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343782 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455493:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587212.455495:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455500:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cda00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587212.455502:0:8116:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455508:0:8116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587212.455513:0:8116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587212.455518:0:8116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788587212.455520:0:8116:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788587212.455521:0:8116:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788587212.455529:0:8116:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455533:0:8116:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587212.455542:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455552:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf421cda00/0x419e1ae1f6343b17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6343b1e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587212.455576:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587212.455578:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587212.455579:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587212.455595:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469310001792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587212.455652:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587212.455691:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587212.455696:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469310001920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587212.455716:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587212.456324:0:14928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.456400:0:14928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788587212.456407:0:14928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788587212.456415:0:14928:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1788587212.456451:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587212.456458:0:8117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.456466:0:8117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587212.456470:0:8117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.456479:0:8117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587212.456487:0:8117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587212.456492:0:8117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587212.456494:0:8117:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788587212.456496:0:8117:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788587212.456520:0:8117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.456526:0:8117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587212.456536:0:8117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.456556:0:8117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f6343464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f634346b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587212.456570:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587212.456571:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587212.456573:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587212.457106:0:14928:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788587212.457111:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788587212.457116:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587212.457122:0:14928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788587212.457129:0:14928:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8cbe058ab000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587212.457135:0:14928:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8cbf3e05b800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587212.457139:0:14928:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8cbf0878cd40) has exports, disconnecting them 00000020:00080000:1.0:1788587212.457144:0:14928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cbe058ab000), last request at 1788587210 00000020:00000080:1.0:1788587212.457151:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343743 00000100:00080000:1.0:1788587212.457168:0:14928:0:(import.c:65:import_set_state_nolock()) ffff8cbe058ae000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788587212.457204:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587212.457211:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788587212.457223:0:14928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe058ab000): rc 0 00000020:00000080:1.0:1788587212.457226:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbe058ab000/lustre-MDT0001-lwp-OST0001_UUID 00000100:00100000:3.0:1788587212.457234:0:6458:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000020:00080000:1.0:1788587212.457240:0:14928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cbf3e05b800), last request at 1788587210 00000100:00100000:3.0:1788587212.457243:0:6458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000020:00000080:1.0:1788587212.457247:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634361d 00000100:00080000:1.0:1788587212.457258:0:14928:0:(import.c:65:import_set_state_nolock()) ffff8cbf3e05f800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788587212.457275:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe058ab000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788587212.457316:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe058ae000 for lustre-MDT0001 00010000:00010000:1.0:1788587212.457573:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788587212.457648:0:14928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf3e05b800): rc 0 00000020:00000080:1.0:1788587212.457651:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf3e05b800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788587212.457662:0:14928:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb6254183bae0 00000020:00000080:1.0:1788587212.457674:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3e05b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788587212.457780:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3e05f800 for lustre-MDT0001 00000100:00080000:1.0:1788587212.457833:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587212.457842:0:14928:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8cbe0586d880 x1875469309999488/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788587223 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587212.457855:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1788587212.457888:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310001792 00000100:00100000:3.0:1788587212.457896:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310001792 00000100:00100000:3.0:1788587212.458009:0:6458:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788587212.458019:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310001920 00000100:00100000:3.0:1788587212.458022:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310001920 00000100:00100000:3.0:1788587212.458100:0:14929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587212.458109:0:14929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3472:x1875469310001792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788587212.458115:0:14929:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587212 with bad export cookie 4728246216586179425 00000100:00100000:3.0:1788587212.458195:0:14929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3472:x1875469310001792:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (2542us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788587212.458210:0:14929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788587212.458245:0:3472:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587212.458250:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbf080a0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788587212.458253:0:3472:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788587212.458874:0:14928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587212.458881:0:14928:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1788587212.459971:0:14929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788587212.459980:0:14929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3472:x1875469310001920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788587212.459988:0:14929:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587212 with bad export cookie 4728246216586179425 00000100:00100000:1.0:1788587212.460071:0:14929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3472:x1875469310001920:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (4348us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788587212.460078:0:14929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788587212.460155:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788587212.460160:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788587212.460173:0:14928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788587212.460262:0:14928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1788587212.460611:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587212.460947:0:14928:0:(import.c:65:import_set_state_nolock()) ffff8cbf34096800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788587212.460967:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788587212.460970:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788587212.460982:0:14928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788587212.461056:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310002304:0@lo:9:umount.0 00000100:00100000:1.0:1788587212.461110:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587212.461150:0:14928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788587212.461164:0:14928:0:(import.c:65:import_set_state_nolock()) ffff8cbf36b02800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788587212.461180:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310002432:0@lo:9:umount.0 00000100:00100000:1.0:1788587212.461206:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788587212.461253:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8cbf0878cd40) has no exports 00000100:00080000:3.0:1788587212.481912:0:3472:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.114@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788587212.481918:0:3472:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788587212.481927:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf36f2ad80 x1875469309999872/t0(0) o400->MGC192.168.203.114@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788587226 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587212.481974:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe0586e300 x1875469310001664/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587228 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587212.481985:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf34a51f80 x1875469310001792/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587228 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587212.481993:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf34a51180 x1875469310001920/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587228 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788587212.482497:0:3472:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788587212.482502:0:3472:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788587212.482503:0:3472:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788587212.485648:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:0:1875469310002176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587212.485648:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5a87955-d364-4ecd-b672-456c35aa135f:0:1875469310002048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587212.485696:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5a87955-d364-4ecd-b672-456c35aa135f:3473:1875469309999872:0@lo:400:kworker.0 00000100:00100000:0.0:1788587212.485766:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469309999488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587212.485829:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5a87955-d364-4ecd-b672-456c35aa135f:3475:1875469310001664:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788587212.487224:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbf080a0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587212.487235:0:3472:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 174 00000100:00080000:3.0:1788587212.487244:0:3472:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import ffff8cbf080a0000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587212.487606:0:3472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34a50380 x1875469310002560/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587212.487650:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5a87955-d364-4ecd-b672-456c35aa135f:3471:1875469310002560:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788587212.488222:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469310002560 offset 0 length 520: 4 00000100:00100000:3.0:1788587212.488441:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469310001920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587212.488448:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5a87955-d364-4ecd-b672-456c35aa135f:3472:1875469310001792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587212.488858:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310002304 00000100:00100000:3.0:1788587212.488866:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310002304 00000100:00100000:3.0:1788587212.489028:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310002432 00000100:00100000:3.0:1788587212.489032:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310002432 00000100:00100000:3.0:1788587212.489060:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587212.489068:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1875469310002304:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788587212.489092:0:8101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634366a 00000100:00080000:3.0:1788587212.489100:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587212.489130:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788587212.489416:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3471:x1875469310002304:12345-0@lo:9:umount.0 Request processed in 348us (28305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587212.489423:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587212.489437:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788587212.489442:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1875469310002432:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788587212.489458:0:8101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63437d6 00000100:00080000:3.0:1788587212.489463:0:8101:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bdd6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587212.489479:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788587212.490152:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3471:x1875469310002432:12345-0@lo:9:umount.0 Request processed in 707us (28942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587212.490160:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788587212.490186:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587212.490192:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587212.490222:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf36b02800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788587212.490234:0:3471:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788587212.490236:0:3471:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587212.490240:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310002432:0@lo:9:umount.0 00000100:00080000:3.0:1788587212.490252:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf34096800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788587212.490258:0:3471:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788587212.490271:0:3471:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587212.490274:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310002304:0@lo:9:umount.0 00000100:00080000:1.0:1788587212.490569:0:6468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000400:00000100:2.0:1788587212.493129:0:6457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875469310001664 offset 224 length 224: 4 00000100:00100000:2.0:1788587212.493214:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3475:x1875469310001664:12345-0@lo:103:ldlm_bl.0 Request processed in 37820us (41372us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788587212.493226:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00080000:1.0:1788587212.501080:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8cbf0878cd40) has no exports 00000020:01000000:1.0:1788587212.535147:0:14928:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe040b0c60 - data ffff8cbf2fb71870/ffff8cbf34b4d400 00000020:01000000:1.0:1788587212.535420:0:14928:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf05708420 - data ffff8cbf07ab0e58/ffff8cbf2712c000 00000001:00000004:1.0:1788587212.550002:0:14928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788587212.609442:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587212.609450:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788587212.609457:0:14928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788587212.610642:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587212.610648:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788587212.610695:0:14928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587212.610698:0:14928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788587212.611052:0:8431:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788587212.611061:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788587212.611073:0:8431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788587212.614033:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587212.614041:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788587212.614062:0:14928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587212.614065:0:14928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587212.614921:0:9520:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587212.614926:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788587212.614947:0:9520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788587212.685696:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343487 00000020:00000080:0.0:1788587212.685709:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf062a3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788587212.686606:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634349c 00000020:00000080:0.0:1788587212.686614:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf34291800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587212.686791:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf062a3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788587212.689107:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788587212.689119:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587212.689129:0:14928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587212.689135:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8cbf087899c0) has no exports 00000004:01000000:0.0:1788587212.689372:0:14928:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788587212.689382:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63437a5 00000020:00000080:0.0:1788587212.689391:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf36b06800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587212.689926:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf34291800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788587212.690003:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788587212.690009:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587212.690017:0:14928:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788587212.690021:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8cbe044f0000) has no exports 00000020:00000080:0.0:1788587212.690028:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634379e 00000020:00000080:0.0:1788587212.690033:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf36b02000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788587212.690776:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf36b06800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788587212.690787:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf36b02000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788587212.691402:0:14928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788587212.691407:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788587212.691410:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788587212.691416:0:14928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587212.691418:0:14928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587212.691455:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587212.691465:0:14928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587212.691472:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343663 00000020:00000080:0.0:1788587212.691488:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf41765000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788587212.691493:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788587212.691496:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587212.691499:0:14928:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788587212.691501:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8cbf41a33380) has no exports 00000020:00000080:0.0:1788587212.691505:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634365c 00000020:00000080:0.0:1788587212.691508:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf34097800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788587212.691853:0:14928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788587212.691857:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788587212.691859:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1788587212.691863:0:14928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587212.691864:0:14928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587212.691890:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587212.691987:0:14928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788587212.692001:0:14928:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788587212.692008:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63434bf 00000020:00000080:0.0:1788587212.692012:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf372b1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788587212.692017:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788587212.692020:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587212.692023:0:14928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788587212.692025:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8cbf087199c0) has no exports 00000020:00000080:0.0:1788587212.692029:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63434b8 00000020:00000080:0.0:1788587212.692031:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf3bf3a000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788587212.692789:0:14928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788587212.692810:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587212.692814:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788587212.692819:0:14928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587212.692849:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587212.693169:0:14928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587212.693195:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587212.693198:0:14928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587212.693203:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf062a5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788587212.693218:0:14928:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf062a5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788587212.693225:0:14928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587212.693597:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63434a3 00000020:00000080:0.0:1788587212.693605:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf34295800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788587212.693611:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788587212.693615:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587212.693620:0:14928:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587212.693623:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8cbf08788000) has no exports 00000020:00000080:0.0:1788587212.693640:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587212.693643:0:14928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788587212.693647:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63434aa 00000020:00000080:0.0:1788587212.693650:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf34296800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788587212.693657:0:14928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf04818800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788587212.693661:0:14928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf04818800 2 00000020:01000004:0.0:1788587212.693664:0:14928:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbf04818800 from lustre-MDT0001 00000020:00000080:0.0:1788587212.693681:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587212.693684:0:14928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788587212.693686:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf062a2800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788587212.693689:0:14928:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf062a2800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788587212.693695:0:14928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788587212.693722:0:14928:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788587212.693725:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788587212.693728:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587212.693732:0:14928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788587212.693738:0:14928:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8cbf062a4800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587212.693743:0:14928:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8cbf0871cd40) has exports, disconnecting them 00000020:00080000:0.0:1788587212.693747:0:14928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8cbf062a4800), last request at 1788586992 00000020:00000080:0.0:1788587212.693751:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63434fe 00000020:00080000:0.0:1788587212.693756:0:14928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf062a4800): rc 0 00000020:00000080:0.0:1788587212.693760:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf062a4800/lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788587212.694535:0:14928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788587212.694549:0:14928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587212.694552:0:14928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788587212.694558:0:14928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587212.694687:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587212.694694:0:14928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788587212.694698:0:14928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf04818800 1 00000020:00000080:0.0:1788587212.694703:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634343a 00000020:00000080:0.0:1788587212.694708:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf057ba800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788587212.694714:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788587212.694717:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587212.694720:0:14928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/5 00000020:00080000:0.0:1788587212.694722:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8cbf0878b380) has no exports 00000020:00000080:1.0:1788587212.695083:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf36b02800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788587212.695091:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf0493a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587212.695093:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0493a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788587212.695103:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788587212.695374:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf41765000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788587212.695875:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf34097800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788587212.695880:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf34096800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788587212.695885:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf11b49800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587212.695887:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf11b49800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788587212.695890:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788587212.695946:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf372b1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788587212.695953:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3bf3a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788587212.695959:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3bf3e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788587212.695973:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf3bf3c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587212.695975:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3bf3c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788587212.695978:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788587212.697088:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf34295800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788587212.697194:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf062a6000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788587212.697197:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf062a6000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788587212.697201:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788587212.698503:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf34296800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788587212.698512:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf062a4800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788587212.698517:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf062a1800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788587212.698523:0:496:0:(genops.c:885:class_export_put()) final put ffff8cbf062a6800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788587212.698525:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf062a6800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788587212.698529:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788587212.699063:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf057ba800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788587212.715350:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587212.715367:0:14928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788587212.715372:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf0481a000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788587212.715376:0:14928:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0481a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788587212.715385:0:14928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788587212.717568:0:14928:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbf0481a800 00000020:01000000:1.0:1788587212.717594:0:14928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788587212.717600:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587212.717604:0:14928:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587212.717608:0:14928:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8cbf062b99c0) has no exports 00000100:00100000:3.0:1788587212.720998:0:13560:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8cbf41a19600:13560] 4 exiting: rc = 0 00000100:00100000:3.0:1788587212.721128:0:6472:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8cbf02f4ba00:6472] 0 exiting: rc = 1 00000100:00100000:2.0:1788587212.722623:0:6474:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8cbf0536a000:6474] 2 exiting: rc = 0 00000100:00100000:2.0:1788587212.722712:0:8126:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8cbe037a4600:8126] 3 exiting: rc = 0 00000100:00100000:1.0:1788587212.723771:0:6473:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8cbf11b65a00:6473] 1 exiting: rc = 0 00000100:00100000:1.0:1788587212.728650:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728669:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728676:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728681:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728699:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728715:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728727:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728732:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728738:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728743:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728748:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728759:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728764:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728769:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728774:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728779:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728784:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728789:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728810:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728816:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728821:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728826:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728833:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728839:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728846:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728854:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728861:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728872:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728878:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728884:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728888:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728893:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728898:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728904:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728909:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728915:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728920:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728926:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728939:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728952:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728958:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728983:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728990:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.728997:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729003:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729009:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729014:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729019:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729025:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729030:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729035:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729112:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729120:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729125:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729130:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729136:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729141:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729214:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729223:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729229:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729236:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729248:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729257:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.729273:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743332:0:14171:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8cbf36b5e000:14171] 2 exiting: rc = 0 00000100:00100000:0.0:1788587212.743333:0:6475:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cbf11b64600:6475] 0 exiting: rc = 1 00000100:00100000:1.0:1788587212.743334:0:6476:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cbf0536be00:6476] 1 exiting: rc = 0 00000100:00100000:2.0:1788587212.743525:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743534:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743540:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743547:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743553:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743558:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743565:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743571:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743577:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743582:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743587:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743602:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743608:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743613:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743618:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743622:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743627:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743632:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743637:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743641:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743646:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743653:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743659:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743664:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743671:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743677:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743683:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743689:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743695:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743700:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743706:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743713:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743721:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743725:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743729:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743733:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743743:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743747:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743751:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743754:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743758:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743763:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743768:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743772:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743776:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743781:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743791:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743823:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743828:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743834:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743839:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743845:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743851:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743858:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743864:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743878:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743886:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743892:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743896:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743900:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743905:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743909:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743914:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.743923:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.745654:0:6478:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8cbf0536bc00:6478] 1 exiting: rc = 0 00000100:00100000:1.0:1788587212.745782:0:6477:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8cbf053fb600:6477] 0 exiting: rc = 1 00000100:00100000:2.0:1788587212.745884:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745896:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745904:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745909:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745916:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745947:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745953:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745958:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745964:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745970:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745976:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745984:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745992:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.745999:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746004:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746017:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746023:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746050:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746055:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746061:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746066:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746071:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746077:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746082:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746097:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746103:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746109:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746115:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746120:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746140:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746146:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746151:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746157:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746163:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746168:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746173:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746179:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746184:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746190:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746196:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746208:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746227:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746234:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746239:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746253:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746259:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746264:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746270:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746275:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746280:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746285:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746290:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746300:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746317:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746323:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746328:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746334:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746339:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746345:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746351:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746356:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746364:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746370:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.746382:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587212.756545:0:6479:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cbf053faa00:6479] 0 exiting: rc = 1 00000100:00100000:1.0:1788587212.756654:0:6480:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cbf053fb400:6480] 1 exiting: rc = 0 00000100:00100000:3.0:1788587212.757292:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757304:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757311:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757317:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757324:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757330:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757335:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757340:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757346:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757351:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757356:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757361:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757366:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757372:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757377:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757382:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757387:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757393:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757398:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757403:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757408:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757413:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757418:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757423:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757428:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757432:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757437:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757448:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757453:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757458:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757475:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757480:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757484:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757490:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757496:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757501:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757506:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757511:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757516:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757521:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757525:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757530:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757534:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757539:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757543:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757548:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757553:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757557:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757562:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757568:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757573:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757578:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757583:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757588:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757593:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757597:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757601:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757606:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757611:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757616:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757621:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757626:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757631:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.757636:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587212.758222:0:6482:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cbf02f4b200:6482] 1 exiting: rc = 0 00000100:00100000:0.0:1788587212.758227:0:6481:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cbf053fba00:6481] 0 exiting: rc = 1 00000100:00100000:3.0:1788587212.758315:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758329:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758383:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758389:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758395:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758401:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758407:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758412:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758418:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758423:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758429:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758435:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758440:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758445:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758450:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758456:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758460:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758466:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758471:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758476:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758481:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758486:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758490:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758495:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758500:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758505:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758511:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758516:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758521:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758526:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758530:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758535:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758540:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758545:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758550:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758555:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758567:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758571:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758578:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758584:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758589:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758594:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758599:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758604:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758609:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758614:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758619:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758624:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758629:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758634:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758639:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758645:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758651:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758655:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758661:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758666:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758672:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758677:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758683:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758689:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758694:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758699:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758704:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.758709:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759227:0:6484:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cbf0398c800:6484] 1 exiting: rc = 0 00000100:00100000:2.0:1788587212.759463:0:6483:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cbf02f4a800:6483] 0 exiting: rc = 1 00000100:00100000:3.0:1788587212.759549:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759556:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759561:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759566:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759571:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759576:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759591:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759596:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759601:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759607:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759612:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759618:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759622:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759627:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759632:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759637:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759643:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759648:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759654:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759659:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759663:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759668:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759673:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759677:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759683:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759688:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759693:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759697:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759703:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759708:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759715:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759721:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759725:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759730:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759735:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759878:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759887:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759892:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759897:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759902:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759907:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759918:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759924:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759928:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759942:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759948:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759953:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759958:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759962:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759967:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759972:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759977:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759982:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759987:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759993:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.759998:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.760003:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.760074:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.760081:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.760085:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.760091:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.760096:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.760102:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.760107:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587212.760731:0:6485:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8cbf053ec800:6485] 0 exiting: rc = 1 00000100:00100000:3.0:1788587212.761409:0:6487:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8cbf053edc00:6487] 2 exiting: rc = 0 00000100:00100000:2.0:1788587212.761729:0:6486:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8cbf053ed800:6486] 1 exiting: rc = 0 00000100:00100000:3.0:1788587212.761848:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761855:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761874:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761880:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761886:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761891:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761896:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761901:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761906:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761910:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761915:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761948:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761954:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761959:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761965:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761970:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761975:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761981:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761986:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761991:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.761997:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762002:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762017:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762023:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762028:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762034:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762053:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762060:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762066:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762072:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762077:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762083:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762088:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762094:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762100:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762106:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762111:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762116:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762121:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762126:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762131:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762137:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762143:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762149:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762154:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762160:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762171:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762178:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762184:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762189:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762209:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762215:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762220:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762225:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762230:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762236:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762242:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762247:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762253:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762258:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762264:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762269:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762277:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587212.762290:0:14928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788587212.766887:0:14928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587212.766900:0:14928:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788587212.766905:0:14928:0:(genops.c:885:class_export_put()) final put ffff8cbf0539e800/MDS_uuid 00000020:00000080:3.0:1788587212.766909:0:14928:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0539e800/MDS_uuid for MDS 00000020:01000000:3.0:1788587212.766915:0:14928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788587212.767107:0:14928:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788587213.229706:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587214.251299:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587215.275973:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788587215.421091:0:15079:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788587215.434548:0:15079:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788587215.434607:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587215.434622:0:15079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587215.434631:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587215.434639:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587215.434770:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788587215.434789:0:15079:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788587215.434971:0:15079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1788587215.434973:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788587215.434977:0:15079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788587215.434982:0:8116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587215.434993:0:8116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587215.434997:0:8116:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587215.435006:0:8116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587215.435025:0:8116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587215.435031:0:8116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788587215.435034:0:8116:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788587215.435036:0:8116:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1788587215.435042:0:15079:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788587215.435050:0:8116:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbf080a0000 00000100:00080000:0.0:1788587215.435052:0:15079:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1788587215.435055:0:8116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587215.435059:0:15079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587215.435063:0:15079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:3.0:1788587215.435067:0:8116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37104000/0x419e1ae1f6343877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f634387e expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587215.435068:0:15079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788587215.435083:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587215.435085:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587215.435088:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587215.437994:0:15079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788587215.438003:0:15079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788587215.438010:0:15079:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788587215.438045:0:15079:0:(import.c:65:import_set_state_nolock()) ffff8cbf3d10c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788587215.438534:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469310002688:0@lo:39:umount.0 00000400:00000100:3.0:1788587215.438585:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310002688 offset 0 length 224: 4 00000100:00080000:1.0:1788587215.915164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587215.915174:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587215.915193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587215.915197:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788587215.915208:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf04939800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587215.915218:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 408 00000100:00080000:1.0:1788587215.915223:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788587215.915231:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbf04939800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587215.915332:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d54380 x1875469310002816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587215.915456:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587215.915608:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310002816:0@lo:38:kworker.0 00000400:00000100:3.0:1788587215.915669:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310002816 offset 0 length 520: 4 00000100:00100000:2.0:1788587215.916708:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310002944:0@lo:400:kworker.0 00000400:00000100:2.0:1788587215.916839:0:3473:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310002944 offset 0 length 224: 4 00010000:00010000:1.0:1788587216.301195:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587216.492448:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788587216.492456:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbf3bdd5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587216.492484:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3bdd5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788587216.492743:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3bdd6000 for lustre-OST0001 00010000:00010000:0.0:1788587217.323095:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788587217.526280:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587217.526288:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbe040c2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587217.526305:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe040c2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788587217.526355:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe040c2000 for lustre-OST0000 00000100:00080000:2.0:1788587217.964427:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587217.964435:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587217.964438:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587217.964440:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587217.964587:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310003072:0@lo:400:kworker.0 00000400:00000100:3.0:1788587217.964638:0:3473:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310003072 offset 0 length 224: 4 00010000:00010000:0.0:1788587218.347308:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587219.371482:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587220.395552:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587220.971067:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587220.971076:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587220.971078:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587220.971082:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587220.971333:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310003200:0@lo:400:kworker.0 00000400:00000100:2.0:1788587220.971395:0:3474:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310003200 offset 0 length 224: 4 00010000:00010000:0.0:1788587221.422114:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587222.058931:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587212/real 1788587212] req@ffff8cbf34a50380 x1875469310002560/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587222.058977:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf34a50380 x1875469310002560/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587222.058997:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf080a0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587222.059021:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788587222.059025:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5a87955-d364-4ecd-b672-456c35aa135f:3471:1875469310002560:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788587222.059210:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587222.059215:0:496:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788587222.059217:0:496:0:(import.c:65:import_set_state_nolock()) ffff8cbf080a0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587222.059222:0:496:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1788587222.059227:0:496:0:(import.c:630:import_select_connection()) MGC192.168.203.114@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587222.059233:0:496:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import ffff8cbf080a0000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587222.059260:0:496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0372d500 x1875469310003328/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587222.059290:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587222.059305:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587222.059419:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587222.059433:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310003456:0@lo:400:kworker.0 00000400:00000100:2.0:1788587222.059484:0:3474:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310003456 offset 0 length 224: 4 00000100:00100000:3.0:1788587222.059675:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5a87955-d364-4ecd-b672-456c35aa135f:3471:1875469310003328:0@lo:250:kworker.0 00000400:00000100:3.0:1788587222.059698:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469310003328 offset 0 length 520: 4 00010000:00010000:0.0:1788587222.443122:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587223.467450:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587224.492695:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587225.131636:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587215/real 1788587215] req@ffff8cbe0372f100 x1875469310002688/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587225.131663:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe0372f100 x1875469310002688/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587225.131682:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3d10c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788587225.131702:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469310002688:0@lo:39:umount.0 00000100:00080000:1.0:1788587225.131930:0:15079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788587225.131935:0:15079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788587225.131941:0:15079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788587225.135104:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587225.135122:0:15079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587225.135131:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587225.135139:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587225.135179:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587225.135187:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587225.135194:0:15079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587225.135200:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587225.135207:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587225.135228:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788587225.135233:0:15079:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788587225.135254:0:15079:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788587225.135258:0:15079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788587225.135262:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587225.135268:0:15079:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587225.135272:0:15079:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8cbe037a8000) has no exports 00000020:00080000:1.0:1788587225.135294:0:15079:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8cbe037a8000) has no exports 00010000:00010000:0.0:1788587225.136460:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587225.136468:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.136477:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587225.136480:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.136501:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587225.136508:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587225.136513:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587225.136515:0:6460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788587225.136517:0:6460:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788587225.136530:0:6460:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbf080a0000 00010000:00010000:0.0:1788587225.136533:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.136540:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37104a00/0x419e1ae1f6343885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f634388c expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.136552:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587225.136566:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.136570:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587225.136573:0:6460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.136579:0:6460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587225.136585:0:6460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587225.136589:0:6460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788587225.136591:0:6460:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788587225.136593:0:6460:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788587225.136597:0:6460:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbf080a0000 00010000:00010000:0.0:1788587225.136610:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.136617:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf00031a00/0x419e1ae1f6343b09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6343b10 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.136627:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587225.136628:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587225.136630:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587225.137116:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788587225.143889:0:15079:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf11b476c0 - data ffff8cbf3ca19ca8/ffff8cbf35f74c00 00000020:01000000:1.0:1788587225.144016:0:15079:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf087fb1e0 - data ffff8cbf07a35870/ffff8cbe03771000 00100000:10000000:0.0:1788587225.163915:0:15079:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788587225.245206:0:15079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63435d7 00000020:00000080:3.0:1788587225.245214:0:15079:0:(genops.c:885:class_export_put()) final put ffff8cbf391c3000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788587225.245230:0:15079:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf3d10b000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788587225.245233:0:15079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf3d10b000 2 00000020:01000004:3.0:1788587225.245236:0:15079:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbf3d10b000 from lustre-OST0000 00000020:00000080:3.0:1788587225.245256:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587225.245265:0:15079:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788587225.245268:0:15079:0:(genops.c:885:class_export_put()) final put ffff8cbf062a4000/lustre-OST0000_UUID 00000020:00000080:3.0:1788587225.245270:0:15079:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf062a4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788587225.245291:0:15079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788587225.245328:0:15079:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788587225.245332:0:15079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788587225.245335:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587225.245351:0:15079:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788587225.245358:0:15079:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cbe03e1e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587225.245364:0:15079:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8cbf41a34d40) has exports, disconnecting them 00000020:00080000:3.0:1788587225.245368:0:15079:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cbe03e1e000), last request at 1788587006 00000020:00000080:3.0:1788587225.245372:0:15079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343601 00000020:00080000:3.0:1788587225.245381:0:15079:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe03e1e000): rc 0 00000020:00000080:3.0:1788587225.245384:0:15079:0:(genops.c:885:class_export_put()) final put ffff8cbe03e1e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788587225.246441:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf391c3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788587225.246451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e1e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788587225.250178:0:15079:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788587225.250187:0:15079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587225.250192:0:15079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788587225.250199:0:15079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587225.250375:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587225.250384:0:15079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788587225.250391:0:15079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788587225.250396:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587225.250400:0:15079:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788587225.250407:0:15079:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8cbe03e1c800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587225.250413:0:15079:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8cbf41a30000) has exports, disconnecting them 00000020:00080000:3.0:1788587225.250417:0:15079:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8cbe03e1c800), last request at 1788587006 00000020:00000080:3.0:1788587225.250421:0:15079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343616 00000020:00080000:3.0:1788587225.250435:0:15079:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe03e1c800): rc 0 00000020:00000080:3.0:1788587225.250440:0:15079:0:(genops.c:885:class_export_put()) final put ffff8cbe03e1c800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788587225.251000:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe03e1b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788587225.251008:0:36:0:(genops.c:885:class_export_put()) final put ffff8cbe03e1d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788587225.251010:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e1d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788587225.251028:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788587225.251083:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e1c800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788587225.427141:0:15079:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788587225.427150:0:15079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587225.427154:0:15079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788587225.427162:0:15079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587225.427245:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3d10c000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788587225.427629:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587225.427637:0:15079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788587225.427643:0:15079:0:(genops.c:885:class_export_put()) final put ffff8cbe03e19800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788587225.427771:0:15079:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e19800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788587225.427786:0:15079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788587225.427871:0:15079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf3d10b000 1 00000020:00000080:2.0:1788587225.427877:0:15079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634359f 00000020:00000080:2.0:1788587225.427885:0:15079:0:(genops.c:885:class_export_put()) final put ffff8cbf11b4b000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788587225.427895:0:15079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788587225.427900:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587225.427904:0:15079:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587225.427908:0:15079:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8cbf3b8899c0) has no exports 00000020:00000080:1.0:1788587225.427957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf11b4b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788587225.483758:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587225.483771:0:15079:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788587225.483776:0:15079:0:(genops.c:885:class_export_put()) final put ffff8cbf3d10e000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788587225.483781:0:15079:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3d10e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788587225.483791:0:15079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788587225.484176:0:15079:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbf3d10a000 00000020:02000400:2.0:1788587225.484220:0:15079:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788587225.515103:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587226.539998:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587227.183247:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587227.183256:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587227.183258:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587227.183261:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587227.183423:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587227.183442:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310003584:0@lo:400:kworker.0 00000400:00000100:3.0:1788587227.183504:0:3473:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310003584 offset 0 length 224: 4 00010000:00010000:0.0:1788587227.564421:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788587228.035268:0:15235:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788587228.045001:0:15235:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788587228.046025:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.046039:0:15235:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.046252:0:15235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.046260:0:15235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.046325:0:15235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788587228.046331:0:15235:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788587228.046353:0:15235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587228.046363:0:15235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf35d54380 x1875469310002816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788587230 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587228.046379:0:15235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788587228.046411:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf04939800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587228.046427:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788587228.046432:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310002816:0@lo:38:kworker.0 00000100:00080000:2.0:1788587228.046461:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587228.046465:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587228.046467:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 1 pingable 1 suppress 0 00000100:00080000:2.0:1788587228.046470:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: DISCONN) 00000100:00100000:2.0:1788587228.046516:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587228.046529:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310003712:0@lo:400:kworker.0 00000400:00000100:2.0:1788587228.046574:0:3472:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310003712 offset 0 length 224: 4 00000100:00080000:2.0:1788587228.046648:0:15235:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788587228.046653:0:15235:0:(import.c:65:import_set_state_nolock()) ffff8cbf04939800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788587228.046665:0:15235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587228.046667:0:15235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587228.046670:0:15235:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788587228.047479:0:15235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587228.047491:0:15235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf35d54a80 x1875469310002944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587231 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587228.047516:0:15235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe03d9ca80 x1875469310003072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587233 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587228.047525:0:15235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe0372ca80 x1875469310003200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587236 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587228.047543:0:15235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe0372ed80 x1875469310003456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587238 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587228.047551:0:15235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf35d55f80 x1875469310003584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587243 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587228.047559:0:15235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe03d9e680 x1875469310003712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587244 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587228.047567:0:15235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788587228.047605:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310003712:0@lo:400:kworker.0 00000100:00100000:0.0:1788587228.048343:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310003456:0@lo:400:kworker.0 00000100:00100000:0.0:1788587228.048353:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310003200:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.048821:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310003584:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.048839:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310003072:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.048847:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310002944:0@lo:400:kworker.0 00000100:00080000:3.0:1788587228.048871:0:15235:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788587228.048891:0:15235:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c0800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788587228.049037:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.049046:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.049057:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587228.049061:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.049071:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587228.049079:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587228.049086:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587228.049088:0:6461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788587228.049091:0:6461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788587228.049106:0:6461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbf080a0000 00010000:00010000:1.0:1788587228.049110:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.049131:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37104e00/0x419e1ae1f634385b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6343862 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.049143:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.049144:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.049146:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587228.049251:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469310003840:0@lo:39:umount.0 00000400:00000100:2.0:1788587228.049301:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310003840 offset 0 length 224: 4 00010000:00010000:2.0:1788587228.587472:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587229.611014:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587230.635071:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587231.659539:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587232.106988:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587232.106997:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788587232.683533:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587233.708303:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587234.734843:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587235.758481:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587236.778921:0:8116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587237.291210:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587222/real 1788587222] req@ffff8cbe0372d500 x1875469310003328/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587237.291245:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe0372d500 x1875469310003328/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587237.291283:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf080a0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587237.291313:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788587237.291318:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5a87955-d364-4ecd-b672-456c35aa135f:3471:1875469310003328:0@lo:250:kworker.0 00000100:00080000:1.0:1788587237.291540:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b5a87955-d364-4ecd-b672-456c35aa135f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587237.291545:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788587237.291548:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf080a0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587237.291553:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788587237.291558:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.114@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587237.291565:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import ffff8cbf080a0000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587237.291605:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d54000 x1875469310003968/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587237.291732:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5a87955-d364-4ecd-b672-456c35aa135f:3471:1875469310003968:0@lo:250:kworker.0 00000400:00000100:2.0:1788587237.291817:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469310003968 offset 0 length 520: 4 00010000:00010000:0.0:1788587237.804159:0:8117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587238.314932:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587228/real 1788587228] req@ffff8cbf34a50380 x1875469310003840/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587238 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587238.314980:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf34a50380 x1875469310003840/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587238 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587238.315000:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788587238.315022:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469310003840:0@lo:39:umount.0 00000100:00080000:3.0:1788587238.315085:0:15235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788587238.315090:0:15235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788587238.315096:0:15235:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788587238.316986:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587238.317003:0:15235:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587238.317010:0:15235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587238.317016:0:15235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587238.317045:0:15235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587238.317053:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587238.317062:0:15235:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587238.317084:0:15235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587238.317090:0:15235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587238.317170:0:15235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788587238.317176:0:15235:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788587238.317197:0:15235:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788587238.317201:0:15235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788587238.317206:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587238.317212:0:15235:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788587238.317215:0:15235:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8cbe044f4d40) has no exports 00000020:00080000:3.0:1788587238.317249:0:15235:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8cbe044f4d40) has no exports 00010000:00010000:1.0:1788587238.318671:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587238.318683:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587238.318694:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37105400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587238.318698:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587238.318708:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587238.318730:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587238.318737:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587238.318740:0:6461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788587238.318742:0:6461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788587238.318771:0:6461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbf080a0000 00010000:00010000:1.0:1788587238.318775:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587238.318782:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37105400/0x419e1ae1f6343869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6343870 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788587238.318943:0:15235:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe040b0540 - data ffff8cbf07ab50d8/ffff8cbf34b4f000 00010000:00010000:1.0:1788587238.318990:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587238.318996:0:6461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587238.319004:0:6461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf37104600 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587238.319008:0:6461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587238.319015:0:6461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587238.319021:0:6461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587238.319027:0:6461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788587238.319030:0:6461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788587238.319038:0:6461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788587238.319048:0:6461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbf080a0000 00010000:00010000:0.0:1788587238.319050:0:6460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587238.319052:0:6461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587238.319060:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37104600/0x419e1ae1f6343afb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6343b02 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587238.319078:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587238.319080:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587238.319083:0:6461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788587238.319093:0:15235:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf373fd660 - data ffff8cbf3cb2e5e8/ffff8cbf3cd05400 00100000:10000000:3.0:1788587238.339843:0:15235:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788587238.379739:0:15235:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63436fd 00000020:00000080:0.0:1788587238.379750:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbe058ad000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788587238.379781:0:15235:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe040c5800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788587238.379784:0:15235:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe040c5800 2 00000020:01000004:0.0:1788587238.379787:0:15235:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe040c5800 from lustre-OST0001 00000020:00000080:0.0:1788587238.379859:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587238.379880:0:15235:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788587238.379884:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbe058aa800/lustre-OST0001_UUID 00000020:00000080:0.0:1788587238.379887:0:15235:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe058aa800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788587238.379894:0:15235:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788587238.380015:0:15235:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b5a87955-d364-4ecd-b672-456c35aa135f->MGS 00010000:00010000:0.0:1788587238.380030:0:15235:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482400/0x419e1ae1f6343456 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f634345d expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587238.380042:0:15235:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482400/0x419e1ae1f6343456 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f634345d expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587238.380048:0:15235:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788587238.380051:0:15235:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788587238.380054:0:15235:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788587238.380067:0:15235:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbf080a0000 00010000:00010000:0.0:1788587238.380086:0:15235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482400/0x419e1ae1f6343456 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f634345d expref: -99 pid: 7260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587238.380112:0:15235:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f63438d2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587238.380119:0:15235:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f63438d2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587238.380124:0:15235:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587238.380126:0:15235:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788587238.380128:0:15235:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788587238.380138:0:15235:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbf080a0000 00010000:00010000:0.0:1788587238.380141:0:15235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf37104c00/0x419e1ae1f63438cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f63438d2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587238.380157:0:15235:0:(import.c:65:import_set_state_nolock()) ffff8cbf080a0000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788587238.380161:0:15235:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788587238.380163:0:15235:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788587238.380165:0:15235:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788587238.380169:0:15235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788587238.380179:0:15235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf35d54000 x1875469310003968/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788587257 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788587238.380341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe058ad000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1788587238.380507:0:15235:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788587238.380511:0:15235:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:2.0:1788587238.381200:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5a87955-d364-4ecd-b672-456c35aa135f:3471:1875469310003968:0@lo:250:kworker.0 10000000:01000000:1.0:1788587238.381426:0:15235:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788587238.381435:0:15235:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343353 00000020:00000080:1.0:1788587238.381441:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbf05398800/b5a87955-d364-4ecd-b672-456c35aa135f 00000020:01000000:1.0:1788587238.381454:0:15235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.114@tcp (flags='') 00000020:00000080:1.0:1788587238.381463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf05398800/b5a87955-d364-4ecd-b672-456c35aa135f for MGC192.168.203.114@tcp 00000020:00000080:1.0:1788587238.381475:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587238.381481:0:15235:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.114@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788587238.381485:0:15235:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8cbf053a99c0) has no exports 10000000:01000000:1.0:1788587238.381500:0:6469:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788587238.381568:0:15235:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.114@tcp: client import never connected 00000100:00080000:1.0:1788587238.381571:0:15235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788587238.381574:0:15235:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788587238.381576:0:15235:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788587238.381578:0:15235:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788587238.381607:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587238.381612:0:15235:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.114@tcp (uuid b5a87955-d364-4ecd-b672-456c35aa135f) 00000020:01000000:1.0:1788587238.381618:0:15235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788587238.381621:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587238.381624:0:15235:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587238.381628:0:15235:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cbf0493f800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587238.381642:0:15235:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8cbf3b88cd40) has exports, disconnecting them 00000020:00080000:1.0:1788587238.381646:0:15235:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cbf0493f800), last request at 1788587023 00000020:00000080:1.0:1788587238.381649:0:15235:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6343727 00000020:00080000:1.0:1788587238.381660:0:15235:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf0493f800): rc 0 00000020:00000080:1.0:1788587238.381664:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbf0493f800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788587238.381692:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0493f800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788587238.383453:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf080a0000 for MGC192.168.203.114@tcp 00000020:00000080:0.0:1788587238.383467:0:36:0:(genops.c:885:class_export_put()) final put ffff8cbf080a0800/b5a87955-d364-4ecd-b672-456c35aa135f 00000020:00000080:0.0:1788587238.383471:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf080a0800/b5a87955-d364-4ecd-b672-456c35aa135f for MGC192.168.203.114@tcp 00000020:01000000:0.0:1788587238.383478:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.114@tcp (b5a87955-d364-4ecd-b672-456c35aa135f) 00010000:01000000:1.0:1788587238.394979:0:15235:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788587238.394988:0:15235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587238.394993:0:15235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788587238.395000:0:15235:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587238.395190:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587238.395199:0:15235:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788587238.395205:0:15235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788587238.395210:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587238.395215:0:15235:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587238.395222:0:15235:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8cbf3d10d000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587238.395228:0:15235:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8cbf3b888000) has exports, disconnecting them 00000020:00080000:1.0:1788587238.395233:0:15235:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8cbf3d10d000), last request at 1788587023 00000020:00000080:1.0:1788587238.395237:0:15235:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634373c 00000020:00080000:1.0:1788587238.395250:0:15235:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf3d10d000): rc 0 00000020:00000080:1.0:1788587238.395255:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbf3d10d000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788587238.395322:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf04939800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788587238.395329:0:36:0:(genops.c:885:class_export_put()) final put ffff8cbf0493b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788587238.395332:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0493b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788587238.395353:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788587238.396780:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3d10d000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788587238.399932:0:15235:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788587238.399940:0:15235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587238.399944:0:15235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788587238.399951:0:15235:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587238.400066:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe040c0800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788587238.400376:0:8116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788587238.400745:0:8117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788587238.400978:0:6460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788587238.401218:0:6461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788587238.401462:0:9059:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8cbf3bd9e600:9059] 2 exiting: rc = 0 00000100:00100000:0.0:1788587238.401557:0:6455:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cbf117ffe00:6455] 0 exiting: rc = 1 00000100:00100000:1.0:1788587238.402048:0:6456:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cbf06356c00:6456] 1 exiting: rc = 0 00000100:00100000:2.0:1788587238.405998:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587238.406618:0:6459:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cbf06357800:6459] 2 exiting: rc = 0 00000100:00100000:2.0:1788587238.409910:0:6457:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cbf126d3400:6457] 0 exiting: rc = 1 00000100:00100000:3.0:1788587238.410241:0:14929:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cbf07c1e000:14929] 3 exiting: rc = 0 00000100:00100000:3.0:1788587238.410317:0:6458:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cbf06356800:6458] 1 exiting: rc = 0 00000100:00100000:2.0:1788587238.411144:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411153:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411160:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411165:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411171:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411177:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411199:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411204:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411210:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411216:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411222:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411227:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411232:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411238:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411243:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411249:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411255:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411261:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411267:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411273:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411278:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411284:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411289:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411295:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411299:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411304:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411310:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411315:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411320:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411326:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411332:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411337:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411342:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411348:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411353:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411695:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411702:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411708:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411713:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411718:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411723:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411738:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411742:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411747:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411752:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411756:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411772:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411777:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411781:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411786:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411791:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411887:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411891:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411896:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411901:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411905:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411911:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411916:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411921:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411925:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411929:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411935:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411940:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.411945:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788587238.413949:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587238.413960:0:15235:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788587238.413966:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbf0493f000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788587238.413981:0:15235:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0493f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788587238.413989:0:15235:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788587238.414030:0:15235:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe040c5800 1 00000020:00000080:3.0:1788587238.414045:0:15235:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63436cc 00000020:00000080:3.0:1788587238.414051:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbe03e1b800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788587238.414064:0:15235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788587238.414069:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587238.414074:0:15235:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788587238.414077:0:15235:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8cbe044f19c0) has no exports 00000020:00000080:0.0:1788587238.415475:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e1b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788587238.448962:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587238.448987:0:15235:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788587238.448993:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbe03e1f800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788587238.448998:0:15235:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e1f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788587238.449013:0:15235:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788587238.449204:0:15235:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbe03e18800 00000020:01000000:0.0:1788587238.449330:0:15235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788587238.449335:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587238.449340:0:15235:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788587238.449344:0:15235:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8cbf41a319c0) has no exports 00000020:00000080:0.0:1788587238.449368:0:15235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587238.449374:0:15235:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788587238.449377:0:15235:0:(genops.c:885:class_export_put()) final put ffff8cbf11b4a000/OSS_uuid 00000020:00000080:0.0:1788587238.449380:0:15235:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf11b4a000/OSS_uuid for OSS 00000020:01000000:0.0:1788587238.449384:0:15235:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788587238.453098:0:8100:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8cbf36e4aa00:8100] 1 exiting: rc = 0 00000100:00080000:0.0:1788587238.453179:0:6468:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788587238.453904:0:8099:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8cbf41a3d800:8099] 0 exiting: rc = 1 00000100:00100000:2.0:1788587238.454221:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8cbe037a5800:8449] 3 exiting: rc = 0 00000100:00100000:3.0:1788587238.455343:0:8101:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8cbf36e4a000:8101] 2 exiting: rc = 0 00000100:00100000:2.0:1788587238.455481:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455495:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455502:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455508:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455516:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455531:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455535:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455540:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455545:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455549:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455554:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455569:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455574:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455579:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455584:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455589:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455593:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455598:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455603:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455607:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455613:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455617:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455622:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455626:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455630:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455635:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455639:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455644:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455648:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455653:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455657:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455662:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455666:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455670:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455674:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455679:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455683:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455687:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455691:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455697:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455701:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455706:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455724:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455730:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455734:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455739:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455750:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455754:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455771:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455776:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455780:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455785:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455790:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455822:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455828:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455832:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455837:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455843:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455848:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455853:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455858:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455864:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455869:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.455874:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587238.459920:0:8104:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cbf36e4b200:8104] 1 exiting: rc = 0 00000100:00100000:2.0:1788587238.461740:0:8103:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cbf36e4b800:8103] 0 exiting: rc = 1 00000100:00100000:0.0:1788587238.461885:0:9561:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8cbe04911000:9561] 2 exiting: rc = 0 00000100:00100000:2.0:1788587238.464296:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464306:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464312:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464316:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464321:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464326:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464331:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464336:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464341:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464345:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464350:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464355:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464359:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464364:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464368:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464372:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464387:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464392:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464396:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464401:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464405:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464409:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464414:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464418:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464422:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464426:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464430:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464435:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464439:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464443:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464447:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464452:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464456:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464460:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464464:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464468:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464472:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464476:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464481:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464485:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464489:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464493:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464497:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464502:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464506:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464511:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464516:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464530:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464535:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464540:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464545:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464557:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464562:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464568:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464573:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464578:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464584:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464589:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464594:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464599:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464605:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464610:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464616:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.464624:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587238.465915:0:8106:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cbf36e4a400:8106] 1 exiting: rc = 0 00000100:00100000:2.0:1788587238.466896:0:8105:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cbf36e4ba00:8105] 0 exiting: rc = 1 00000100:00100000:1.0:1788587238.468921:0:8107:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cbf36e4ae00:8107] 2 exiting: rc = 0 00000100:00100000:3.0:1788587238.470637:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470649:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470655:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470661:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470668:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470693:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470702:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470708:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470714:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470720:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470726:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470732:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470737:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470743:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470749:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470755:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470772:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470779:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470784:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470791:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470811:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470818:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470823:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470828:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470833:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470838:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470844:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470849:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470869:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470889:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470896:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470901:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470906:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470911:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470916:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470921:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470925:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470931:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470936:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470941:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470946:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470951:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470955:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470962:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.470969:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471239:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471245:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471250:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471256:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471263:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471267:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471272:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471277:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471299:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471307:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471314:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471319:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471324:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471329:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471334:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471339:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471346:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471351:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.471363:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.485459:0:8109:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cbf3b966600:8109] 1 exiting: rc = 0 00000100:00100000:0.0:1788587238.489221:0:8108:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cbf41a3cc00:8108] 0 exiting: rc = 1 00000100:00100000:3.0:1788587238.492895:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492904:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492909:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492914:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492919:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492924:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492929:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492934:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492939:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492945:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492950:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492955:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492960:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492964:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.492969:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493186:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493192:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493198:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493203:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493209:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493214:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493219:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493225:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493230:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493236:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493241:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493247:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493252:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493257:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493263:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493268:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493275:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493280:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493300:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493305:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493311:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493317:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493322:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493328:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493333:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493339:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493344:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493349:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493355:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493360:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493364:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493369:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493374:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493378:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493383:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493388:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493393:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493397:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493402:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493407:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493411:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493415:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493420:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493425:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493430:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493434:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493438:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493443:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.493450:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.496512:0:8111:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cbf371f6200:8111] 1 exiting: rc = 0 00000100:00100000:2.0:1788587238.498309:0:8110:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cbf3b966800:8110] 0 exiting: rc = 1 00000100:00100000:3.0:1788587238.498453:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498462:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498479:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498498:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498504:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498510:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498525:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498532:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498539:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498545:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498551:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498569:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498577:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498583:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498590:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498596:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498602:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498608:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498615:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498621:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498627:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498632:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498638:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498659:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498667:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498673:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498679:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498685:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498690:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498695:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498702:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498708:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498714:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498720:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498726:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498746:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498753:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498925:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498939:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498945:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498951:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498957:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.498964:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499209:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499220:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499227:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499233:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499255:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499264:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499269:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499276:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499282:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499290:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499298:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499304:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499310:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499316:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499323:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499330:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499352:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499360:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499366:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499374:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587238.499379:0:15235:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788587238.515393:0:15235:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788587256.174401:0:15959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788587263.759584:0:16424:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587263.759603:0:16424:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788587263.759678:0:16424:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe04f8d000 00000020:01000004:2.0:1788587263.759690:0:16424:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788587263.759697:0:16424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788587263.759708:0:16424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cbf41a319c0) 00000020:00000080:2.0:1788587263.759717:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587263.772001:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788587263.773772:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788587263.774191:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 209: rc = 0 00100000:10000000:2.0:1788587263.774265:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 209: rc = 0 00100000:10000000:2.0:1788587263.774359:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 209: rc = 0 00100000:10000000:2.0:1788587263.774457:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 209: rc = 0 00100000:10000000:2.0:1788587263.774616:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 209: rc = 0 00100000:10000000:2.0:1788587263.774714:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 209: rc = 0 00100000:10000000:2.0:1788587263.775161:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788587263.775234:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 209: rc = 0 00100000:10000000:2.0:1788587263.775478:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 211: rc = 0 00100000:10000000:2.0:1788587263.776509:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 603: rc = 0 00100000:10000000:2.0:1788587263.776624:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 603: rc = 0 00100000:10000000:2.0:1788587263.777124:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 392: rc = 0 00100000:10000000:2.0:1788587263.777369:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 392: rc = 0 00100000:10000000:2.0:1788587263.777765:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587263.778078:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587263.778332:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587263.778571:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 392: rc = 0 00100000:10000000:2.0:1788587263.778910:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587263.779174:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 392: rc = 0 00100000:10000000:2.0:1788587263.779412:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587263.779663:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587263.780007:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 392: rc = 0 00100000:10000000:2.0:1788587263.780253:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 392: rc = 0 00100000:10000000:2.0:1788587263.780671:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 773: rc = 0 00100000:10000000:2.0:1788587263.781003:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 773: rc = 0 00100000:10000000:2.0:1788587263.781247:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 773: rc = 0 00100000:10000000:2.0:1788587263.781494:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 773: rc = 0 00100000:10000000:2.0:1788587263.781758:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 773: rc = 0 00100000:10000000:2.0:1788587263.782072:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 773: rc = 0 00100000:10000000:2.0:1788587263.782294:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 773: rc = 0 00100000:10000000:2.0:1788587263.782532:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 773: rc = 0 00100000:10000000:2.0:1788587263.782762:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 773: rc = 0 00100000:10000000:2.0:1788587263.783065:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 773: rc = 0 00100000:10000000:2.0:1788587263.783276:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 773: rc = 0 00100000:10000000:2.0:1788587263.783493:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 773: rc = 0 00100000:10000000:2.0:1788587263.783724:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 773: rc = 0 00100000:10000000:2.0:1788587263.784020:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 773: rc = 0 00100000:10000000:2.0:1788587263.784233:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 773: rc = 0 00100000:10000000:2.0:1788587263.784440:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 773: rc = 0 00100000:10000000:2.0:1788587263.784687:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 773: rc = 0 00100000:10000000:2.0:1788587263.785014:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 773: rc = 0 00100000:10000000:2.0:1788587263.785274:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 773: rc = 0 00100000:10000000:2.0:1788587263.785516:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 773: rc = 0 00100000:10000000:2.0:1788587263.785762:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 773: rc = 0 00100000:10000000:2.0:1788587263.786080:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 773: rc = 0 00100000:10000000:2.0:1788587263.786294:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 773: rc = 0 00100000:10000000:2.0:1788587263.786685:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 773: rc = 0 00100000:10000000:2.0:1788587263.786993:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 773: rc = 0 00100000:10000000:2.0:1788587263.787224:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 773: rc = 0 00100000:10000000:2.0:1788587263.787454:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 773: rc = 0 00100000:10000000:2.0:1788587263.787691:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 773: rc = 0 00100000:10000000:2.0:1788587263.787986:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 773: rc = 0 00100000:10000000:2.0:1788587263.788246:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 773: rc = 0 00100000:10000000:2.0:1788587263.788492:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 773: rc = 0 00100000:10000000:2.0:1788587263.788748:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 773: rc = 0 00100000:10000000:2.0:1788587263.789160:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 770: rc = 0 00100000:10000000:2.0:1788587263.789354:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 770: rc = 0 00100000:10000000:2.0:1788587263.790184:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788587263.790356:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 606: rc = 0 00100000:10000000:2.0:1788587263.790539:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788587263.790620:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 606: rc = 0 00100000:10000000:2.0:1788587263.790886:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788587263.790955:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 606: rc = 0 00100000:10000000:2.0:1788587263.791306:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788587263.791374:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 604: rc = 0 00100000:10000000:2.0:1788587263.791561:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788587263.791638:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 604: rc = 0 00100000:10000000:2.0:1788587263.791892:0:16424:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788587263.791960:0:16424:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 604: rc = 0 00000020:00000080:2.0:1788587263.792215:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788587263.792223:0:16424:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587263.792233:0:16424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63448bc 00000020:01000004:2.0:1788587263.792240:0:16424:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788587263.792244:0:16424:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788587263.792249:0:16424:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe04f8d000 from MGS 00000020:01000004:2.0:1788587263.792253:0:16424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788587263.792263:0:16424:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cbf41a30000) 00000020:00000080:2.0:1788587263.792271:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788587263.792320:0:16424:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe04f8d000 from MGS, refs=2 00080000:01000000:2.0:1788587263.792325:0:16424:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788587263.792330:0:16424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63448ca 00000100:00100000:2.0:1788587263.792423:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788587263.792552:0:16424:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788587263.792558:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788587263.793197:0:16424:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788587263.793202:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788587263.794160:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587263.794326:0:16424:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788587263.794338:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788587263.795103:0:16424:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788587263.795112:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788587263.795402:0:16424:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788587263.795408:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788587263.796072:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587263.796076:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587263.796078:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587263.796344:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587263.796354:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587263.796356:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587263.796843:0:16424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788587263.799177:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788587263.808716:0:16424:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788587263.808732:0:16424:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788587263.808735:0:16424:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788587263.813738:0:16433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788587263.814252:0:16424:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788587263.814363:0:16424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788587263.815279:0:16424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788587263.815602:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587263.815767:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788587263.819280:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788587263.820927:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788587263.820937:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788587263.824918:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788587263.824931:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788587263.826314:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788587263.826336:0:16424:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.114@tcp' 00000020:01000004:2.0:1788587263.826338:0:16424:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788587263.826370:0:16424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.114@tcp (typ=mgc) 00000020:00000080:2.0:1788587263.826383:0:16424:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.114@tcp (ffff8cbf41a34d40) 00000020:00000080:2.0:1788587263.826397:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788587263.826476:0:16424:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe040c6000@MGC192.168.203.114@tcp: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587263.826646:0:16424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.114@tcp-0 is initialized 00000040:01000000:2.0:1788587263.826652:0:16424:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788587263.827431:0:16438:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788587263.828501:0:16439:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788587263.828598:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.114@tcp (uuid 524e146e-34e9-4e2a-818d-ac1a7cb53ea4) 00000020:00000080:2.0:1788587263.828790:0:16424:0:(genops.c:1385:class_connect()) connect: client 524e146e-34e9-4e2a-818d-ac1a7cb53ea4, cookie 0x419e1ae1f63448d8 00000100:00080000:2.0:1788587263.828895:0:16424:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587263.828903:0:16424:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import ffff8cbe040c6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587263.828935:0:16424:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03d9dc00 x1875469310004096/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587263.828967:0:16424:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS 00000020:01000004:2.0:1788587263.828995:0:16424:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788587263.829001:0:16424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788587263.829014:0:16424:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cbf41a33380) 00000020:00000080:2.0:1788587263.829025:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788587263.829134:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3471:1875469310004096:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788587263.829337:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587263.829404:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310004096 00000100:00100000:3.0:1788587263.829412:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310004096 00000100:00100000:3.0:1788587263.829444:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587263.829452:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3471:x1875469310004096:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788587263.829473:0:16435:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 524e146e-34e9-4e2a-818d-ac1a7cb53ea4@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:3.0:1788587263.829504:0:16435:0:(genops.c:1385:class_connect()) connect: client 524e146e-34e9-4e2a-818d-ac1a7cb53ea4, cookie 0x419e1ae1f63448e6 00000100:00080000:3.0:1788587263.829646:0:16435:0:(import.c:65:import_set_state_nolock()) ffff8cbe066fe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587263.829704:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+5:3471:x1875469310004096:12345-0@lo:250:mount.lustre.0 Request processed in 252us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587263.829712:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587263.829847:0:3471:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788587263.829856:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.114@tcp: connect to target with instance 0 00000100:00080000:0.0:1788587263.829862:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788587263.829867:0:3471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788587263.829870:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788587263.829872:0:3471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788587263.829880:0:3471:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788587263.829884:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3471:1875469310004096:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788587263.844529:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587263.844885:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788587263.844892:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788587263.846193:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788587263.846212:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788587263.847539:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587263.847551:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788587263.848597:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587263.848777:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788587263.848783:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788587263.849579:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788587263.849598:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788587263.891903:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587263.892118:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788587263.892124:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788587263.893631:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788587263.893642:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788587263.894653:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587263.895296:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587263.895302:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788587263.895687:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587263.895693:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788587263.896553:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587263.896705:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587263.896710:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788587263.897402:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587263.897410:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788587263.898371:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587263.898519:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587263.898524:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788587263.899423:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587263.899432:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788587263.922726:0:16424:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587263.923404:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788587263.923411:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788587263.924972:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788587263.924982:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788587263.926326:0:16424:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788587263.926337:0:16424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788587263.927648:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788587263.927672:0:16424:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788587263.927678:0:16424:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788587263.927954:0:16424:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788587263.927986:0:16424:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788587263.927990:0:16424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788587263.927992:0:16424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587263.927993:0:16424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587263.927994:0:16424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587263.927996:0:16424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587263.927997:0:16424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587263.927998:0:16424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587263.928000:0:16424:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587263.928001:0:16424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587263.928003:0:16424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587263.928005:0:16424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788587263.928007:0:16424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587263.928009:0:16424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587263.928009:0:16424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587263.928011:0:16424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587263.928012:0:16424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587263.928013:0:16424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587263.928014:0:16424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587263.928015:0:16424:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587263.928016:0:16424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587263.928017:0:16424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587263.928351:0:16424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788587263.928371:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004224:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587263.928442:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587263.928534:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03630c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587263.928580:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310004224 00000100:00100000:2.0:1788587263.928600:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310004224 00000100:00100000:2.0:1788587263.928675:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587263.928684:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+5:16424:x1875469310004224:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788587263.928736:0:16437:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788587263.928739:0:16437:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788587263.928742:0:16437:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788587263.929339:0:16458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788587263.929742:0:16437:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788587263.936048:0:16459:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788587263.936056:0:16459:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788587263.936060:0:16459:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788587263.936062:0:16459:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788587263.936108:0:16459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788587263.936692:0:16437:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788587263.936702:0:16437:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788587263.943143:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+5:16424:x1875469310004224:12345-0@lo:253:mount.lustre.0 Request processed in 14451us (14692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587263.943167:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587263.943369:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004224:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788587263.943385:0:16424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788587263.943388:0:16424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587263.943389:0:16424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587263.943391:0:16424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587263.943392:0:16424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587263.943393:0:16424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587263.943394:0:16424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587263.943395:0:16424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587263.943397:0:16424:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587263.943399:0:16424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587263.943400:0:16424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788587263.943419:0:16424:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe04f8d000 from lustre-MDT0000 10000000:01000000:3.0:1788587263.943444:0:16424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788587263.943446:0:16424:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788587263.943451:0:16424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cbf41a34d40 10000000:01000000:3.0:1788587263.943455:0:16424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587263.943463:0:16424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbf41a34d40 from 1 10000000:01000000:3.0:1788587263.943466:0:16424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788587263.943504:0:16424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587263.943516:0:16424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587263.943524:0:16424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587263.943647:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587263.943686:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587263.943763:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03630240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587263.944324:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310004352 00000100:00100000:1.0:1788587263.944331:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310004352 00000100:00100000:1.0:1788587263.944407:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587263.944416:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+5:16424:x1875469310004352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587263.944430:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587263.944446:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499f400/0x419e1ae1f63448f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63448ed expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587263.944471:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499f400/0x419e1ae1f63448f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63448ed expref: 6 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587263.944495:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499f400/0x419e1ae1f63448f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63448ed expref: 6 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587263.944506:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f400, rc 0) 00000100:00100000:1.0:1788587263.944573:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+6:16424:x1875469310004352:12345-0@lo:101:mount.lustre.0 Request processed in 158us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587263.944580:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587263.944659:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587263.944674:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.944684:0:16424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587263.944740:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587263.944769:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587263.945050:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bf2a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587263.945291:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310004480 00000100:00100000:3.0:1788587263.945296:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310004480 00000100:00100000:3.0:1788587263.945322:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587263.945328:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+6:16424:x1875469310004480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587263.945534:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+6:16424:x1875469310004480:12345-0@lo:501:mount.lustre.0 Request processed in 205us (764us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587263.945628:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587263.945696:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004480:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788587263.945726:0:16424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788587263.945778:0:16424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.945788:0:16424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587263.945830:0:16424:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe04f8d000 10000000:01000000:0.0:1788587263.945834:0:16424:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788587263.945838:0:16424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cbe04f8d000 10000000:01000000:0.0:1788587263.945841:0:16424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788587263.945844:0:16424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cbe04f8d000 from 1 10000000:01000000:0.0:1788587263.945847:0:16424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788587263.945868:0:16424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.945876:0:16424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.945885:0:16424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587263.945898:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587263.945927:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587263.945945:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bf2a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587263.946048:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310004608 00000100:00100000:3.0:1788587263.946053:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310004608 00000100:00100000:3.0:1788587263.946084:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587263.946090:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+6:16424:x1875469310004608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587263.946099:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587263.946111:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf3c00/0x419e1ae1f6344902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63448fb expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587263.946128:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf3c00/0x419e1ae1f6344902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63448fb expref: 7 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587263.946136:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf3ccf3c00/0x419e1ae1f6344902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63448fb expref: 7 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587263.946144:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3c00, rc 0) 00000100:00100000:3.0:1788587263.946177:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+7:16424:x1875469310004608:12345-0@lo:101:mount.lustre.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587263.946191:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587263.946402:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587263.946414:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.946432:0:16424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587263.946444:0:16424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788587263.946662:0:16424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.946671:0:16424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587263.946676:0:16424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788587263.946680:0:16424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587263.946684:0:16424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cbe04f8d000 10000000:01000000:0.0:1788587263.946687:0:16424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788587263.946689:0:16424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788587263.946691:0:16424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788587263.946706:0:16424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.946713:0:16424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.946721:0:16424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587263.946733:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587263.946757:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587263.946775:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bf2a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587263.946877:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310004736 00000100:00100000:3.0:1788587263.946882:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310004736 00000100:00100000:3.0:1788587263.946912:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587263.946918:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+7:16424:x1875469310004736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587263.946925:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587263.946933:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf2a00/0x419e1ae1f6344910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344909 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587263.946947:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf2a00/0x419e1ae1f6344910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344909 expref: 8 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587263.946956:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf3ccf2a00/0x419e1ae1f6344910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344909 expref: 8 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587263.946963:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2a00, rc 0) 00000100:00100000:3.0:1788587263.946990:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+8:16424:x1875469310004736:12345-0@lo:101:mount.lustre.0 Request processed in 72us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587263.946995:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587263.947134:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587263.947145:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587263.947261:0:16424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587263.947304:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587263.947327:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587263.947351:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bf2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587263.947387:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310004864 00000100:00100000:2.0:1788587263.947391:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310004864 00000100:00100000:2.0:1788587263.947427:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587263.947432:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+8:16424:x1875469310004864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587263.947776:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+9:16424:x1875469310004864:12345-0@lo:501:mount.lustre.0 Request processed in 343us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587263.947783:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587263.947996:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587263.948033:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587263.948067:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587263.948090:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3bf2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587263.948276:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310004992 00000100:00100000:2.0:1788587263.948281:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310004992 00000100:00100000:2.0:1788587263.948315:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587263.948321:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+9:16424:x1875469310004992:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587263.948760:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+9:16424:x1875469310004992:12345-0@lo:503:mount.lustre.0 Request processed in 437us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587263.948767:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587263.949345:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310004992:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587263.950082:0:16460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16460:1875469310005120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587263.950145:0:16460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587263.950235:0:16460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03630f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587263.950483:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310005120 00000100:00100000:0.0:1788587263.950490:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310005120 00000100:00100000:0.0:1788587263.950642:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587263.950655:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+9:16460:x1875469310005120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587263.951446:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+9:16460:x1875469310005120:12345-0@lo:502:llog_process_th.0 Request processed in 792us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587263.951455:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587263.951534:0:16460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16460:1875469310005120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587263.951634:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587263.951645:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587263.951647:0:16460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788587263.951658:0:16460:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788587263.951668:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587263.951686:0:16460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cbe044f19c0) 00000020:00000080:3.0:1788587263.951703:0:16460:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788587263.951709:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788587263.951783:0:16460:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788587263.951790:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f634491e 00000020:00000080:3.0:1788587263.952420:0:16460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788587263.952425:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587263.952430:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587263.952432:0:16460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788587263.952434:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587263.952439:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587263.952440:0:16460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788587263.952444:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587263.952453:0:16460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cbe044f4d40) 00000020:00000080:3.0:1788587263.952464:0:16460:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788587263.952467:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788587263.952470:0:16460:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788587263.952473:0:16460:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788587263.952479:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788587263.952520:0:16460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe04f8d000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788587263.952531:0:16460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cbe044f0000) 00000020:00000080:3.0:1788587263.952627:0:16460:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788587263.952679:0:16460:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788587263.952688:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6344933 00000020:00000080:3.0:1788587263.952776:0:16460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788587263.952781:0:16460:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788587263.952786:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x419e1ae1f634493a 00080000:01000000:3.0:1788587263.952972:0:16460:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788587263.953132:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6344941 00010000:00010000:0.0:1788587264.050282:0:16460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788587264.051377:0:16460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1788587264.052848:0:16460:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788587264.053418:0:16460:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cbe037ab380) 00000020:00000080:0.0:1788587264.053450:0:16460:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788587264.053515:0:16460:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788587264.053523:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f634494f 00000020:00000080:1.0:1788587264.057324:0:16460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788587264.061956:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x419e1ae1f6344956 00000020:00000080:1.0:1788587264.065206:0:16460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788587264.065221:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587264.065229:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.065231:0:16460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788587264.065234:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788587264.065237:0:16460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788587264.065239:0:16460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587264.065240:0:16460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587264.065242:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788587264.065244:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.065246:0:16460:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788587264.065248:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587264.065252:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.065254:0:16460:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788587264.065258:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788587264.065302:0:16460:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788587264.065319:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587264.065322:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.065324:0:16460:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788587264.065326:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587264.065329:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.065337:0:16460:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788587264.065341:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788587264.065347:0:16460:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:00000080:1.0:1788587264.065375:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587264.065391:0:16460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8cbf3b888000) 00000020:00000080:1.0:1788587264.065408:0:16460:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788587264.065413:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788587264.065471:0:16460:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788587264.065477:0:16460:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788587264.065483:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6344964 00010000:00080000:1.0:1788587264.065516:0:16460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf05497800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587264.068125:0:16460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788587264.072789:0:16460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587264.072953:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788587264.072991:0:16460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788587264.073013:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f634496b 00000100:00080000:3.0:1788587264.073024:0:16460:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587264.073043:0:16460:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf05497800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587264.073078:0:16460:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34a53480 x1875469310005248/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587264.073199:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310005248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587264.073267:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587264.073325:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310005248 00000100:00100000:2.0:1788587264.073349:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310005248 00000100:00100000:2.0:1788587264.073393:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587264.073401:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310005248:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788587264.073416:0:16447:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788587264.073532:0:16460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788587264.073652:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587264.073657:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.073659:0:16460:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788587264.073662:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587264.073665:0:16460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788587264.073667:0:16460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587264.073668:0:16460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587264.073670:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587264.073672:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.073673:0:16460:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587264.073676:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587264.073680:0:16460:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788587264.073684:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.073685:0:16460:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788587264.073689:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587264.073693:0:16460:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:3.0:1788587264.073714:0:16460:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788587264.073717:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587264.073731:0:16460:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cbe044f3380) 00000020:00000080:3.0:1788587264.073743:0:16460:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788587264.073748:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587264.073836:0:16460:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788587264.073842:0:16460:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788587264.073848:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6344979 00010000:00080000:3.0:1788587264.073888:0:16460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf0a386800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587264.074123:0:16460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788587264.074561:0:16460:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788587264.074625:0:16460:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788587264.075420:0:16460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587264.075479:0:16460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788587264.075546:0:16460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788587264.079310:0:16466:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788587264.079317:0:16466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788587264.081760:0:16460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587264.081775:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587264.081981:0:16460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788587264.082002:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6344980 00000100:00080000:3.0:1788587264.082013:0:16460:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587264.082019:0:16460:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbf0a386800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587264.082053:0:16460:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34a51f80 x1875469310005376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587264.082121:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310005376:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788587264.082184:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310005376 offset 0 length 520: 4 00000100:00080000:3.0:1788587264.082339:0:16460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788587264.082445:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587264.082451:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.082453:0:16460:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788587264.082456:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587264.082458:0:16460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788587264.082460:0:16460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587264.082461:0:16460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587264.082463:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587264.082465:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.082467:0:16460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587264.082469:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587264.082473:0:16460:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788587264.082477:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.082478:0:16460:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788587264.082482:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587264.082485:0:16460:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:3.0:1788587264.082505:0:16460:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788587264.082508:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587264.082541:0:16460:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cbf33b0cd40) 00000020:00000080:3.0:1788587264.082555:0:16460:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788587264.082562:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587264.082641:0:16460:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788587264.082648:0:16460:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788587264.082654:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f634498e 00010000:00080000:3.0:1788587264.082683:0:16460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf10f58000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587264.082935:0:16460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788587264.083127:0:16460:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788587264.083156:0:16460:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788587264.085326:0:16460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587264.085393:0:16460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788587264.086066:0:16460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788587264.089730:0:16468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788587264.089738:0:16468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788587264.092564:0:16460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587264.092579:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587264.092630:0:16460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788587264.092658:0:16460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6344995 00000100:00080000:3.0:1788587264.092668:0:16460:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587264.092683:0:16460:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10f58000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587264.092718:0:16460:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34a51180 x1875469310005504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587264.092747:0:16460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788587264.092832:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587264.092837:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.092839:0:16460:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788587264.092843:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587264.092847:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.092849:0:16460:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788587264.092852:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788587264.092853:0:16460:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788587264.092856:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587264.092871:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.092872:0:16460:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788587264.092876:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587264.092878:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.092880:0:16460:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788587264.092884:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788587264.092915:0:16460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16460:1875469310005632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.092990:0:16460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587264.093033:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310005632 00000100:00100000:3.0:1788587264.093039:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310005632 00000100:00100000:3.0:1788587264.093075:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587264.093085:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+9:16460:x1875469310005632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.093518:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+9:16460:x1875469310005632:12345-0@lo:502:llog_process_th.0 Request processed in 433us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.093527:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587264.093577:0:16460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587264.093611:0:16460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16460:1875469310005632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587264.093815:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310005504:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788587264.093847:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310005504 offset 0 length 520: 4 00000020:01000000:3.0:1788587264.093961:0:16460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587264.093967:0:16460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587264.093969:0:16460:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788587264.093973:0:16460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788587264.094350:0:16424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788587264.094369:0:16424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788587264.094391:0:16424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.094403:0:16424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587264.094411:0:16424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe04f8d000 from 1 10000000:01000000:0.0:1788587264.094414:0:16424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587264.094451:0:16424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.094459:0:16424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.094468:0:16424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587264.094492:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310005760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587264.094522:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587264.094549:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a040780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587264.094598:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310005760 00000100:00100000:1.0:1788587264.094605:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310005760 00000100:00100000:1.0:1788587264.094645:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587264.094654:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+9:16424:x1875469310005760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587264.094674:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587264.094688:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634499c expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.094712:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634499c expref: 10 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.094724:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634499c expref: 10 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.094734:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e800, rc 0) 00000100:00100000:1.0:1788587264.094782:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+10:16424:x1875469310005760:12345-0@lo:101:mount.lustre.0 Request processed in 129us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587264.094814:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587264.094999:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310005760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587264.095012:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.095021:0:16424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587264.095601:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310005888:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788587264.095652:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587264.095750:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310005888 00000100:00100000:3.0:1788587264.095757:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310005888 00000100:00100000:3.0:1788587264.095811:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587264.095819:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+10:16424:x1875469310005888:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788587264.095835:0:16436:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788587264.095850:0:16436:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788587264.095912:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+10:16424:x1875469310005888:12345-0@lo:256:mount.lustre.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.095928:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587264.096015:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a040780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587264.096029:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310005888:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788587264.097170:0:16424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587264.097198:0:16424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.097210:0:16424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587264.097218:0:16424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe04f8d000 from 1 10000000:01000000:0.0:1788587264.097221:0:16424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587264.097443:0:16424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.097504:0:16424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.097515:0:16424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587264.097535:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587264.097940:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587264.097969:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a040780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587264.098295:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310006016 00000100:00100000:3.0:1788587264.098304:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310006016 00000100:00100000:3.0:1788587264.098366:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587264.098375:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+10:16424:x1875469310006016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587264.098387:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587264.098404:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63449aa expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.098427:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 11 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.098448:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 11 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.098465:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2800, rc 0) 00000100:00100000:3.0:1788587264.098518:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16424:x1875469310006016:12345-0@lo:101:mount.lustre.0 Request processed in 144us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.098525:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587264.098697:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587264.098714:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.098724:0:16424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587264.098785:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587264.098849:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587264.098868:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587264.098883:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310006144 00000100:00100000:1.0:1788587264.098887:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310006144 00000100:00100000:1.0:1788587264.098920:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587264.098928:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16424:x1875469310006144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587264.099309:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16424:x1875469310006144:12345-0@lo:501:mount.lustre.0 Request processed in 381us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587264.099317:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587264.099355:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587264.099383:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587264.099421:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587264.099446:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837240 going to sleep for 11 seconds 00000100:00100000:3.0:1788587264.099984:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310006272 00000100:00100000:3.0:1788587264.099989:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310006272 00000100:00100000:3.0:1788587264.100048:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587264.100057:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16424:x1875469310006272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587264.100236:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16424:x1875469310006272:12345-0@lo:503:mount.lustre.0 Request processed in 180us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.100244:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587264.100993:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587264.101648:0:16470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16470:1875469310006400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587264.102040:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310005248:12345-0@lo:38:llog_process_th.0 Request processed in 28635us (28768us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587264.102053:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587264.102056:0:16470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587264.102100:0:16470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf348379c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788587264.102222:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587264.102227:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587264.102231:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310005248:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587264.103634:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310006400 00000100:00100000:3.0:1788587264.103658:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310006400 00000100:00100000:3.0:1788587264.103727:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587264.103737:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16470:x1875469310006400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.104313:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16470:x1875469310006400:12345-0@lo:502:llog_process_th.0 Request processed in 576us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.104322:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587264.104530:0:16470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16470:1875469310006400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587264.104564:0:16470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587264.104574:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.104576:0:16470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788587264.104597:0:16470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe04f8d000 00000020:00000080:1.0:1788587264.104601:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587264.104609:0:16470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587264.104612:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.104613:0:16470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788587264.104616:0:16470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587264.104618:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.104620:0:16470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587264.104623:0:16470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe04f8d000 00000020:00000080:1.0:1788587264.104625:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587264.104698:0:16470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587264.104702:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.104703:0:16470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788587264.104705:0:16470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587264.104707:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.104709:0:16470:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587264.104712:0:16470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe04f8d000 00000020:00000080:1.0:1788587264.104714:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587264.104732:0:16470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587264.104735:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.104736:0:16470:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587264.104739:0:16470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587264.104742:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.104743:0:16470:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788587264.104747:0:16470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe04f8d000 00000020:00000080:1.0:1788587264.104749:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788587264.104958:0:16470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16470:1875469310006528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587264.105010:0:16470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587264.105048:0:16470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf348379c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587264.105276:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310006528 00000100:00100000:0.0:1788587264.105283:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310006528 00000100:00100000:0.0:1788587264.105326:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587264.105337:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16470:x1875469310006528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587264.105875:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16470:x1875469310006528:12345-0@lo:502:llog_process_th.0 Request processed in 539us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587264.105884:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587264.105909:0:16470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16470:1875469310006528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587264.105938:0:16470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587264.105945:0:16470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587264.105947:0:16470:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788587264.105951:0:16470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788587264.106243:0:16424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788587264.106263:0:16424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587264.106283:0:16424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.106295:0:16424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587264.106423:0:16424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788587264.106426:0:16424:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe04f8d000 10000000:01000000:0.0:1788587264.106429:0:16424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe04f8d000 10000000:01000000:0.0:1788587264.106559:0:16424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587264.106565:0:16424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe04f8d000 from 1 10000000:01000000:0.0:1788587264.106568:0:16424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587264.106608:0:16424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.106617:0:16424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.106626:0:16424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587264.106644:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587264.107287:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587264.107328:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a040a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587264.107505:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310006656 00000100:00100000:1.0:1788587264.107512:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310006656 00000100:00100000:1.0:1788587264.107557:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587264.107565:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16424:x1875469310006656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587264.107577:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587264.108005:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63449bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63449b8 expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.108035:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63449bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63449b8 expref: 12 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.108048:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63449bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63449b8 expref: 12 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.108057:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fc00, rc 0) 00000100:00100000:1.0:1788587264.108104:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16424:x1875469310006656:12345-0@lo:101:mount.lustre.0 Request processed in 539us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587264.108111:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587264.108428:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587264.108446:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.108527:0:16424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587264.108612:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587264.108645:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587264.109581:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a040a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587264.113020:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310006784 00000100:00100000:3.0:1788587264.113032:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310006784 00000100:00100000:3.0:1788587264.113092:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788587264.113103:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16424:x1875469310006784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587264.113427:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16424:x1875469310006784:12345-0@lo:501:mount.lustre.0 Request processed in 324us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.113446:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587264.114290:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587264.115120:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587264.115270:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587264.115351:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a040a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587264.115391:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310006912 00000100:00100000:3.0:1788587264.115398:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310006912 00000100:00100000:3.0:1788587264.115644:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587264.115655:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16424:x1875469310006912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587264.116011:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16424:x1875469310006912:12345-0@lo:503:mount.lustre.0 Request processed in 349us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.116020:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587264.116119:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310006912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587264.117097:0:16473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16473:1875469310007040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.117899:0:16473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587264.117946:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310007040 00000100:00100000:3.0:1788587264.117953:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310007040 00000100:00100000:3.0:1788587264.117995:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587264.118231:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16473:x1875469310007040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587264.118909:0:16473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587264.121557:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16473:x1875469310007040:12345-0@lo:502:llog_process_th.0 Request processed in 3441us (3607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.121572:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587264.123688:0:16473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16473:1875469310007040:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788587264.123777:0:16473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788587264.123811:0:16473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cbf062b99c0) 00000020:00000080:2.0:1788587264.123830:0:16473:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788587264.123914:0:16473:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe04f8d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788587264.123918:0:16473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe04f8d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788587264.123921:0:16473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe04f8d000 4 00010000:00080000:2.0:1788587264.123971:0:16473:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe03e1c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587264.128320:0:16473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788587264.131339:0:16473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788587264.131765:0:16473:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788587264.131779:0:16473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x419e1ae1f63449cd 00000100:00080000:3.0:1788587264.131790:0:16473:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587264.131822:0:16473:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cbe03e1c000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587264.132627:0:16473:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34a53100 x1875469310007168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587264.132657:0:16473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788587264.132678:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310007168:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587264.133000:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587264.135288:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310007168 00000100:00100000:3.0:1788587264.135300:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310007168 00000100:00100000:3.0:1788587264.135351:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587264.135360:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310007168:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587264.135449:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310007168:12345-0@lo:38:llog_process_th.0 Request processed in 88us (2449us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788587264.135457:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587264.135570:0:16473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16473:1875469310007296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.135631:0:16473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587264.135674:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587264.135683:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587264.135688:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788587264.135692:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310007168:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587264.136275:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310007296 00000100:00100000:3.0:1788587264.136281:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310007296 00000100:00100000:3.0:1788587264.136321:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788587264.136331:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16473:x1875469310007296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.136563:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16473:x1875469310007296:12345-0@lo:502:llog_process_th.0 Request processed in 233us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.136582:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788587264.136653:0:16473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587264.136683:0:16473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16473:1875469310007296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.136732:0:16473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16473:1875469310007424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.136770:0:16473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587264.136808:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310007424 00000100:00100000:3.0:1788587264.136812:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310007424 00000100:00100000:3.0:1788587264.136834:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587264.138103:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16473:x1875469310007424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587264.138312:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16473:x1875469310007424:12345-0@lo:502:llog_process_th.0 Request processed in 1470us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.138322:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587264.139414:0:16473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587264.139668:0:16473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16473:1875469310007424:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788587264.139714:0:16473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788587264.140067:0:16424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788587264.140097:0:16424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788587264.140115:0:16424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.140133:0:16424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788587264.140185:0:16424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788587264.140187:0:16424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788587264.140189:0:16424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587264.140190:0:16424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587264.140191:0:16424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587264.140193:0:16424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587264.140194:0:16424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587264.140195:0:16424:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788587264.140197:0:16424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587264.140198:0:16424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587264.140202:0:16424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788587264.140204:0:16424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587264.140205:0:16424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788587264.140207:0:16424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587264.140208:0:16424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587264.140209:0:16424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587264.140210:0:16424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587264.140211:0:16424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587264.140212:0:16424:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788587264.140213:0:16424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587264.140214:0:16424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587264.140236:0:16424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788587264.140254:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310007552:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587264.140313:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587264.140406:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587264.140417:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310007552 00000100:00100000:2.0:1788587264.140425:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310007552 00000100:00100000:2.0:1788587264.140468:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587264.140476:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16424:x1875469310007552:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788587264.140512:0:16436:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788587264.140525:0:16436:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788587264.185397:0:16436:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788587264.185422:0:16436:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788587264.186914:0:16458:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788587264.186921:0:16458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788587264.186946:0:16458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.186966:0:16458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634499c expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.186975:0:16458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.187286:0:16458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634499c expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.187304:0:16458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634499c expref: 12 pid: 16435 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587264.187319:0:16458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310007680:0@lo:104: 00000100:00100000:0.0:1788587264.187384:0:16458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587264.187424:0:16458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0a040480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587264.188104:0:16425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310007680 00000100:00100000:0.0:1788587264.188112:0:16425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310007680 00000100:00100000:0.0:1788587264.188154:0:16425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587264.188163:0:16425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:16458:x1875469310007680:12345-0@lo:104: 00010000:00010000:0.0:1788587264.188179:0:16425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587264.188240:0:16425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587264.188253:0:16425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:16458:x1875469310007680:12345-0@lo:104: Request processed in 91us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587264.188260:0:16425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587264.188303:0:16458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310007680:0@lo:104: 00010000:00010000:0.0:1788587264.188322:0:16458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.189324:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587264.189333:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.189343:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587264.189355:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.189364:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587264.189371:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587264.189377:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587264.189422:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.189428:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587264.189463:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587264.189472:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27000/0x419e1ae1f634499c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449a3 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587264.189915:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310007808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587264.189969:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587264.190023:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310007808 00000100:00100000:3.0:1788587264.190028:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310007808 00010000:00010000:3.0:1788587264.190056:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634499c expref: 13 pid: 16435 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587264.190078:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587264.190085:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+13:3474:x1875469310007808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587264.190096:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587264.190111:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634499c expref: 13 pid: 16435 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190123:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634499c expref: 13 pid: 16435 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190138:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f63449a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634499c expref: 13 pid: 16435 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190155:0:16427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190163:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587264.190183:0:16427:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003261985s 00010000:00010000:3.0:1788587264.190187:0:16427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190195:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190202:0:16427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190207:0:16427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190213:0:16427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587264.190217:0:16427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190234:0:16427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190251:0:16427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190263:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587264.190268:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587264.190271:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587264.190274:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587264.190545:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:3474:x1875469310007808:12345-0@lo:103:ldlm_bl.0 Request processed in 459us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587264.190553:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788587264.190598:0:16458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587264.190606:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310007808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587264.190609:0:16458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587264.190617:0:16458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f63449d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587264.200364:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16424:x1875469310007552:12345-0@lo:253:mount.lustre.0 Request processed in 59877us (60040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587264.200380:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587264.200713:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16424:1875469310007552:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587264.200730:0:16424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788587264.200733:0:16424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587264.200735:0:16424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587264.200737:0:16424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587264.200738:0:16424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587264.200739:0:16424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587264.200741:0:16424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587264.200743:0:16424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587264.200744:0:16424:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587264.200746:0:16424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587264.200747:0:16424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788587264.200776:0:16424:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788587264.214356:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587264.214532:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587264.215511:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587264.215719:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587264.217524:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587264.217708:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587264.225560:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587264.225749:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587264.226352:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587264.226563:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587264.227008:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587264.227246:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788587264.256354:0:16424:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788587264.256747:0:16424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788587264.257089:0:16484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788587264.257155:0:16484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788587264.257911:0:16424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788587264.259734:0:16484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788587264.259850:0:16484:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:2.0:1788587264.260142:0:16483:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788587264.260146:0:16483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:1.0:1788587264.260470:0:16485:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8cbf35d55500 x1875469310007936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587264.260482:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00000040:01000000:0.0:1788587264.262628:0:16424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788587264.262764:0:16424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788587264.263381:0:16424:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788587264.263390:0:16424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788587264.263536:0:16424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587264.264987:0:16424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788587264.265646:0:16424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788587264.265692:0:16424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788587264.269677:0:16424:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788587264.274484:0:16424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788587264.298880:0:16424:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788587264.298917:0:16424:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb62541c23988 00100000:10000000:2.0:1788587264.298925:0:16424:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788587264.299833:0:16424:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788587264.299848:0:16424:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788587264.299861:0:16424:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788587264.299877:0:16424:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788587264.811953:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587265.195488:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587265.322992:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 10000000:01000000:3.0:1788587265.720106:0:16439:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587265.720115:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe04f8d000 from 7 10000000:01000000:3.0:1788587265.720121:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587265.720168:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587265.720180:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587265.720192:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587265.721089:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310008064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587265.721157:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587265.721201:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ffd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587265.722094:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310008064 00000100:00100000:3.0:1788587265.722106:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310008064 00000100:00100000:3.0:1788587265.722159:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788587265.722169:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+11:16439:x1875469310008064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587265.722187:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587265.722204:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63449db expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587265.723069:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63449db expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587265.723085:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63449db expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587265.723094:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3600, rc 0) 00000100:00100000:3.0:1788587265.723171:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16439:x1875469310008064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1002us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587265.723179:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587265.723328:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310008064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587265.723709:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587265.723719:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587265.724212:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310008192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587265.724945:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587265.724981:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a4039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587265.725713:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310008192 00000100:00100000:2.0:1788587265.725722:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310008192 00000100:00100000:2.0:1788587265.725773:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587265.725783:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16439:x1875469310008192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788587265.725837:0:16436:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788587265.725855:0:16436:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788587265.725858:0:16436:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788587265.725960:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:16439:x1875469310008192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587265.725968:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587265.730752:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310008192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587265.730842:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587265.730853:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587265.730864:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587265.835270:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587266.221260:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587266.347979:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:1.0:1788587266.859009:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587267.370862:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:0.0:1788587267.892246:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587268.394874:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00000001:02000400:3.0:1788587268.588890:0:16728:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788587268.909902:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587269.166315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788587269.166323:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788587269.166341:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587269.166350:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:0.0:1788587269.166357:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587269.166364:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf05497800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587269.166388:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0372d180 x1875469310008448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587269.166404:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587269.166409:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587269.166412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587269.166415:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587269.166417:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788587269.166420:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788587269.166422:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587269.166428:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cbe03e1c000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587269.166442:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0372fb80 x1875469310008576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587269.168089:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310008448:0@lo:38:kworker.0 00000100:00100000:2.0:1788587269.168168:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587269.168223:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310008576:0@lo:38:kworker.0 00000100:00100000:2.0:1788587269.168249:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587269.168650:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310008320:0@lo:400:kworker.0 00000100:00100000:1.0:1788587269.168734:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587269.168860:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310008576 00000100:00100000:1.0:1788587269.168869:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310008576 00000100:00100000:1.0:1788587269.168919:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587269.168926:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469310008576:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788587269.168954:0:16444:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1788587269.168992:0:16444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x419e1ae1f63449e9 00000004:00100000:1.0:1788587269.169008:0:16444:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587269.169152:0:16444:0:(import.c:65:import_set_state_nolock()) ffff8cbf11b4b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587269.169223:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1875469310008576:12345-0@lo:38:kworker.0 Request processed in 282us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587269.169231:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587269.169280:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310008320 00000100:00100000:1.0:1788587269.169284:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310008320 00000100:00100000:1.0:1788587269.169318:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587269.169327:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:3475:x1875469310008320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587269.169365:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:3475:x1875469310008320:12345-0@lo:400:kworker.0 Request processed in 40us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587269.169371:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587269.169767:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310008320:0@lo:400:kworker.0 00010000:00080000:1.0:1788587269.169931:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe0372fb80 x1875469310008576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587269.169936:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310008448 00000100:00100000:3.0:1788587269.169943:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310008448 00000100:00080000:1.0:1788587269.169949:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788587269.169958:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788587269.169963:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788587269.169965:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587269.169971:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310008576:0@lo:38:kworker.0 00000100:00100000:3.0:1788587269.169982:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587269.169990:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310008448:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788587269.170014:0:16448:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788587269.189262:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310008448:12345-0@lo:38:kworker.0 Request processed in 19262us (21085us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587269.189277:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788587269.189351:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587269.189358:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587269.189362:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310008448:0@lo:38:kworker.0 00000100:00100000:2.0:1788587269.424592:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:0.0:1788587269.931956:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587270.442946:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:0.0:1788587270.959944:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587271.467809:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:2.0:1788587271.978919:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587272.495989:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:0.0:1788587273.002907:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587273.514873:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:0.0:1788587274.028065:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587274.283913:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788587274.283921:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788587274.283926:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587274.283935:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:0.0:1788587274.283942:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788587274.283964:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf05497800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587274.283992:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0372d180 x1875469310008832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587274.284006:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587274.284009:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587274.284012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587274.284016:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587274.284093:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587264/real 1788587264] req@ffff8cbf34a51180 x1875469310005504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587274 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587274.284117:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf34a51180 x1875469310005504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587274 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587274.284127:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587264/real 1788587264] req@ffff8cbf34a51f80 x1875469310005376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587274 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587274.284151:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf34a51f80 x1875469310005376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587274 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587274.284182:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310008832:0@lo:38:kworker.0 00000100:00100000:2.0:1788587274.284285:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587274.284310:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310008960:0@lo:400:kworker.0 00000100:00080000:2.0:1788587274.284344:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788587274.284356:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587274.284360:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587274.284374:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310005504:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788587274.284382:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1788587274.284382:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a386800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587274.284389:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587274.284393:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310008704:0@lo:400:kworker.0 00000100:00100000:2.0:1788587274.284395:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310005376:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788587274.284435:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587274.284440:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587274.284445:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788587274.284447:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a386800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587274.284452:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1788587274.284455:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587274.284458:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbf0a386800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587274.284474:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03d9df80 x1875469310009088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587274.284480:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310008704 00000100:00100000:3.0:1788587274.284489:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310008704 00000100:00080000:2.0:1788587274.284490:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587274.284494:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587274.284496:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788587274.284541:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587274.284550:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:3473:x1875469310008704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587274.284595:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:3473:x1875469310008704:12345-0@lo:400:kworker.0 Request processed in 46us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587274.284602:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587274.284643:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310008704:0@lo:400:kworker.0 00000100:00080000:2.0:1788587274.284785:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1788587274.284818:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587274.284822:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10f58000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587274.284836:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03d9f480 x1875469310009216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587274.284858:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310009088:0@lo:8:kworker.0 00000400:00000100:2.0:1788587274.284883:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310009088 offset 0 length 520: 4 00000100:00100000:2.0:1788587274.284907:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310009216:0@lo:8:kworker.0 00000400:00000100:2.0:1788587274.284926:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310009216 offset 0 length 520: 4 00000100:00100000:1.0:1788587274.285084:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310008960 00000100:00100000:1.0:1788587274.285095:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310008960 00000100:00100000:1.0:1788587274.285138:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587274.285145:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310008960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587274.285192:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310008960:12345-0@lo:400:kworker.0 Request processed in 47us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587274.285199:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788587274.285244:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe0372fb80 x1875469310008960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587274.285256:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310008960:0@lo:400:kworker.0 00000100:00100000:0.0:1788587274.285686:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310008832 00000100:00100000:0.0:1788587274.285692:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310008832 00000100:00100000:0.0:1788587274.285722:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587274.285728:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310008832:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788587274.285753:0:16447:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788587274.312701:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310008832:12345-0@lo:38:kworker.0 Request processed in 26964us (28408us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587274.312717:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788587274.312980:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587274.312988:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788587274.312992:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310008832:0@lo:38:kworker.0 00000100:00100000:2.0:1788587274.544013:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00000020:01000004:3.0:1788587274.815882:0:17077:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587274.815886:0:17077:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:3.0:1788587274.815993:0:17077:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe05dae000 00000020:01000004:3.0:1788587274.816009:0:17077:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788587274.816021:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788587274.816035:0:17077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8cbf33b08000) 00000020:00000080:3.0:1788587274.816052:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587274.844072:0:17077:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788587274.844385:0:17077:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788587274.847361:0:17077:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788587274.851668:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-MDT0001 under 437: rc = 0 00100000:10000000:2.0:1788587274.852049:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-client under 437: rc = 0 00100000:10000000:2.0:1788587274.852217:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled params under 437: rc = 0 00100000:10000000:2.0:1788587274.852694:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000 under 457: rc = 0 00100000:10000000:2.0:1788587274.853404:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587274.853888:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000 under 457: rc = 0 00100000:10000000:2.0:1788587274.854284:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587274.854623:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587274.855212:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000 under 457: rc = 0 00100000:10000000:2.0:1788587274.855555:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587274.857282:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587274.857646:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000 under 457: rc = 0 00100000:10000000:3.0:1788587274.858330:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000-MDT0001 under 457: rc = 0 00100000:10000000:3.0:1788587274.858687:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000 under 457: rc = 0 00100000:10000000:3.0:1788587274.859339:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000 under 457: rc = 0 00100000:10000000:3.0:1788587274.861095:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_15 under 165: rc = 0 00100000:10000000:3.0:1788587274.861416:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_06 under 165: rc = 0 00100000:10000000:3.0:1788587274.861871:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_04 under 165: rc = 0 00100000:10000000:3.0:1788587274.862271:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_01 under 165: rc = 0 00100000:10000000:3.0:1788587274.862660:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_09 under 165: rc = 0 00100000:10000000:3.0:1788587274.863208:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_03 under 165: rc = 0 00100000:10000000:3.0:1788587274.863510:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_10 under 165: rc = 0 00100000:10000000:3.0:1788587274.865238:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_12 under 165: rc = 0 00100000:10000000:3.0:1788587274.865619:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_14 under 165: rc = 0 00100000:10000000:3.0:1788587274.866064:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_07 under 165: rc = 0 00100000:10000000:3.0:1788587274.866426:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_05 under 165: rc = 0 00100000:10000000:3.0:1788587274.867019:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_08 under 165: rc = 0 00100000:10000000:3.0:1788587274.867336:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_00 under 165: rc = 0 00100000:10000000:3.0:1788587274.867691:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_02 under 165: rc = 0 00100000:10000000:3.0:1788587274.868209:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_11 under 165: rc = 0 00100000:10000000:1.0:1788587274.869892:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_13 under 165: rc = 0 00100000:10000000:1.0:1788587274.870371:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_13 under 165: rc = 0 00100000:10000000:1.0:1788587274.870691:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_11 under 165: rc = 0 00100000:10000000:1.0:1788587274.871244:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_02 under 165: rc = 0 00100000:10000000:1.0:1788587274.871603:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_08 under 165: rc = 0 00100000:10000000:1.0:1788587274.872037:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_00 under 165: rc = 0 00100000:10000000:1.0:1788587274.872370:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_05 under 165: rc = 0 00100000:10000000:1.0:1788587274.872711:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_07 under 165: rc = 0 00100000:10000000:1.0:1788587274.873282:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_14 under 165: rc = 0 00100000:10000000:1.0:1788587274.873602:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_12 under 165: rc = 0 00100000:10000000:1.0:1788587274.873998:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_10 under 165: rc = 0 00100000:10000000:1.0:1788587274.874387:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_03 under 165: rc = 0 00100000:10000000:1.0:1788587274.874657:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_01 under 165: rc = 0 00100000:10000000:1.0:1788587274.874956:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_09 under 165: rc = 0 00100000:10000000:1.0:1788587274.875220:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_04 under 165: rc = 0 00100000:10000000:1.0:1788587274.875487:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_06 under 165: rc = 0 00100000:10000000:1.0:1788587274.875737:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_15 under 165: rc = 0 00100000:10000000:1.0:1788587274.876113:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000400:0x1:0x0] under 644: rc = 0 00100000:10000000:1.0:1788587274.876284:0:17077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000401:0x1:0x0] under 644: rc = 0 00000020:00000080:1.0:1788587274.876693:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788587274.876704:0:17077:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788587274.876715:0:17077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f63449f7 00000020:01000004:1.0:1788587274.876722:0:17077:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:1.0:1788587274.876742:0:17077:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788587274.876745:0:17077:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788587274.876751:0:17077:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788587274.876772:0:17077:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:1.0:1788587274.876775:0:17077:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788587274.890040:0:17077:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788587274.890081:0:17077:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.114@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788587274.890085:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788587274.890087:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788587274.890088:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587274.890090:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587274.890091:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587274.890092:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587274.890093:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587274.890095:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587274.890096:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587274.890099:0:17077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788587274.890101:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587274.890102:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788587274.890104:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587274.890105:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587274.890106:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587274.890107:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587274.890108:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587274.890109:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587274.890110:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587274.890136:0:17077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788587274.890156:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009344:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587274.890230:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587274.890286:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a4036c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587274.890573:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310009344 00000100:00100000:3.0:1788587274.890581:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310009344 00000100:00100000:3.0:1788587274.890641:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587274.890650:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:17077:x1875469310009344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587274.890678:0:16435:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788587274.890681:0:16435:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788587274.890688:0:16435:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788587274.910243:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:17077:x1875469310009344:12345-0@lo:253:mount.lustre.0 Request processed in 19585us (20004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587274.910258:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788587274.914096:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009344:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587274.914248:0:17077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788587274.914252:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587274.914254:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788587274.914255:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587274.914257:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587274.914258:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587274.914259:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587274.914262:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587274.914263:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587274.914265:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788587274.914289:0:17077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe05dae000 from lustre-MDT0001 10000000:01000000:1.0:1788587274.914317:0:17077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788587274.914320:0:17077:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788587274.914326:0:17077:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf41a34d40 local copy 00010000:00010000:1.0:1788587274.914336:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587274.914570:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587274.914623:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587274.914710:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a4030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587274.918025:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310009472 00000100:00100000:2.0:1788587274.918038:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310009472 00000100:00100000:2.0:1788587274.918219:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587274.918230:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:17077:x1875469310009472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587274.918582:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:17077:x1875469310009472:12345-0@lo:501:mount.lustre.0 Request processed in 353us (3956us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587274.918591:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788587274.921602:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009472:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788587274.923274:0:17077:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788587274.923538:0:17077:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788587274.923550:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.923561:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587274.923588:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe05dae000 10000000:01000000:0.0:1788587274.923593:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788587274.923604:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cbf41a34d40 10000000:01000000:0.0:1788587274.923607:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788587274.923610:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cbf41a34d40 from 1 10000000:01000000:0.0:1788587274.923613:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788587274.923651:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.923659:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.923670:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587274.923696:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587274.923766:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587274.924269:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310009600 00000100:00100000:3.0:1788587274.924278:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310009600 00000100:00100000:3.0:1788587274.924352:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587274.924362:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+12:17077:x1875469310009600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587274.924374:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587274.924389:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf2000/0x419e1ae1f6344a05 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63449fe expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587274.924423:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf2000/0x419e1ae1f6344a05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63449fe expref: 13 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587274.924435:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf3ccf2000/0x419e1ae1f6344a05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63449fe expref: 13 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587274.924445:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2000, rc 0) 00000100:00100000:0.0:1788587274.924577:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf11913f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587274.925373:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+13:17077:x1875469310009600:12345-0@lo:101:mount.lustre.0 Request processed in 1008us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587274.925382:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587274.925616:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587274.925636:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a05 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.925647:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344a05 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587274.925675:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788587274.925691:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a05 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.925700:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a05 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587274.925727:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cbe05dae000 10000000:01000000:0.0:1788587274.925732:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788587274.925737:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cbe05dae000 from 1 10000000:01000000:0.0:1788587274.925817:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788587274.925846:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.925854:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.925862:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587274.925880:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587274.925913:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587274.925942:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf11913f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587274.926001:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310009728 00000100:00100000:2.0:1788587274.926007:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310009728 00000100:00100000:2.0:1788587274.926042:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587274.926050:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+13:17077:x1875469310009728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587274.926061:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587274.926074:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe062ae600/0x419e1ae1f6344a13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344a0c expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587274.926092:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe062ae600/0x419e1ae1f6344a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344a0c expref: 14 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587274.926101:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe062ae600/0x419e1ae1f6344a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344a0c expref: 14 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587274.926226:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae600, rc 0) 00000100:00100000:2.0:1788587274.926270:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+14:17077:x1875469310009728:12345-0@lo:101:mount.lustre.0 Request processed in 221us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587274.926276:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587274.926350:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587274.926361:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.926369:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587274.926381:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788587274.926397:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.926404:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587274.926417:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788587274.926420:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587274.926425:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cbe05dae000 10000000:01000000:0.0:1788587274.926427:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788587274.926430:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788587274.926432:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788587274.926447:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.926455:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.926461:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587274.926473:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587274.926499:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587274.926530:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf11913f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587274.926586:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310009856 00000100:00100000:1.0:1788587274.926591:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310009856 00000100:00100000:1.0:1788587274.926625:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788587274.926632:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+14:17077:x1875469310009856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587274.926639:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587274.926648:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6344a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344a1a expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587274.926673:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6344a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344a1a expref: 15 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587274.926681:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6344a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344a1a expref: 15 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587274.926687:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499ec00, rc 0) 00000100:00100000:1.0:1788587274.926727:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310009856:12345-0@lo:101:mount.lustre.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587274.926733:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587274.926894:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587274.926905:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587274.926988:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587274.927883:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788587274.932647:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587274.932986:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788587274.933038:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788587274.933088:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788587274.934688:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788587274.934750:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788587274.935009:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788587274.935049:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788587274.935077:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788587274.935643:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788587274.935694:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788587274.935726:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788587274.935776:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788587274.935862:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788587274.935893:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788587274.936280:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788587274.936321:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788587274.936358:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788587274.936407:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788587274.936445:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788587274.936477:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788587274.937697:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788587274.937791:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788587274.937893:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788587274.938099:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788587274.938614:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788587274.938723:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587274.938789:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587274.938953:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf11913900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587274.939688:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310009984 00000100:00100000:2.0:1788587274.939710:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310009984 00000100:00100000:2.0:1788587274.939759:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587274.939768:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310009984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587274.940427:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310009984:12345-0@lo:501:mount.lustre.0 Request processed in 658us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587274.940436:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587274.940889:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310009984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587274.940935:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310010112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587274.940983:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587274.941066:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf11913900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587274.941154:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310010112 00000100:00100000:2.0:1788587274.941160:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310010112 00000100:00100000:2.0:1788587274.941198:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587274.941206:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310010112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587274.941746:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310010112:12345-0@lo:503:mount.lustre.0 Request processed in 540us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587274.941754:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587274.941861:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310010112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587274.942969:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587274.943045:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310010240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587274.943120:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587274.943162:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a403300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587274.943270:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310010240 00000100:00100000:2.0:1788587274.943278:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310010240 00000100:00100000:2.0:1788587274.943326:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587274.943335:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310010240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587274.943683:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310010240:12345-0@lo:502:mount.lustre.0 Request processed in 348us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587274.943690:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587274.943775:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310010240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587274.944035:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788587274.944091:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1788587274.944146:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1788587274.944580:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1788587274.944620:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1788587274.944668:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1788587274.944701:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1788587274.944752:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1788587274.945151:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1788587274.946397:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1788587274.946446:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1788587274.946508:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1788587274.946560:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1788587274.946613:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788587274.946678:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788587274.946713:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788587274.946741:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788587274.946781:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788587274.947044:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788587274.947073:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788587274.947118:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788587274.947156:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788587274.947271:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788587274.947339:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788587274.947378:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788587274.947414:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788587274.947459:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788587274.947493:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788587274.948012:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788587274.948077:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788587274.948112:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788587274.948148:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1788587274.948659:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1788587274.948703:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1788587274.948739:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1788587274.949252:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1788587274.949309:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1788587274.949343:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1788587274.949390:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1788587274.949447:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1788587274.949479:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1788587274.949539:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1788587274.950334:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1788587274.950374:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1788587274.950425:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310010368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587274.950527:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587274.950580:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a403300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587274.950760:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310010368 00000100:00100000:2.0:1788587274.950768:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310010368 00000100:00100000:2.0:1788587274.950864:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587274.950874:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310010368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587274.951474:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310010368:12345-0@lo:502:mount.lustre.0 Request processed in 600us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587274.951493:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788587274.951618:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310010368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587274.951755:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788587274.951768:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788587274.953507:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587274.953531:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587274.953533:0:17078:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788587274.953539:0:17078:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788587274.953549:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587274.953563:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8cbf3b88cd40) 00000020:00000080:1.0:1788587274.953584:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788587274.953590:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788587274.953651:0:17078:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788587274.953660:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f6344a2f 00000020:00000080:1.0:1788587274.954348:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788587274.954354:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587274.954358:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587274.954360:0:17078:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788587274.954363:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587274.954367:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587274.954369:0:17078:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788587274.954373:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587274.954381:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8cbf3b8899c0) 00000020:00000080:1.0:1788587274.954393:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788587274.954397:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788587274.954399:0:17078:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788587274.954402:0:17078:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788587274.954408:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788587274.954452:0:17078:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe05dae000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788587274.954463:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8cbf3b88b380) 00000020:00000080:1.0:1788587274.954481:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788587274.954558:0:17078:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788587274.954566:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6344a44 00000020:00000080:1.0:1788587274.954657:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788587274.954664:0:17078:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788587274.954669:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x419e1ae1f6344a4b 00080000:01000000:1.0:1788587274.954675:0:17078:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788587274.954678:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f6344a52 00010000:00010000:2.0:1788587275.025996:0:17078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788587275.027954:0:17078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788587275.028206:0:17078:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788587275.036335:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788587275.036349:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587275.036356:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587275.036358:0:17078:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788587275.036363:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587275.036369:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587275.036370:0:17078:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788587275.036373:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788587275.036378:0:17078:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:00000080:2.0:1788587275.036406:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587275.036421:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8cbf062b8000) 00000020:00000080:2.0:1788587275.036444:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788587275.036451:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788587275.036554:0:17078:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788587275.036562:0:17078:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788587275.036572:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f6344a60 00010000:00080000:2.0:1788587275.036614:0:17078:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf10959800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587275.043372:0:17078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788587275.045629:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788587275.045644:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788587275.045674:0:17078:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788587275.045695:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6344a67 00000100:00080000:1.0:1788587275.045705:0:17078:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587275.045711:0:17078:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cbf10959800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587275.045744:0:17078:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d56a00 x1875469310010496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587275.045764:0:17078:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788587275.045830:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587275.045834:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587275.045836:0:17078:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788587275.045839:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788587275.045841:0:17078:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788587275.045843:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587275.045844:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587275.045846:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788587275.045848:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587275.045849:0:17078:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788587275.045852:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587275.045857:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587275.045858:0:17078:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788587275.045862:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788587275.045889:0:17078:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788587275.045912:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587275.045915:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587275.045917:0:17078:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788587275.045920:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788587275.045922:0:17078:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788587275.045923:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587275.045925:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587275.045927:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788587275.045929:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587275.045930:0:17078:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788587275.045933:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587275.045936:0:17078:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:1.0:1788587275.045940:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587275.045941:0:17078:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788587275.045944:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788587275.045948:0:17078:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:1.0:1788587275.045969:0:17078:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788587275.045972:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587275.045993:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8cbf181a3380) 00000020:00000080:1.0:1788587275.046005:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788587275.046025:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788587275.046077:0:17078:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788587275.046084:0:17078:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788587275.046090:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f6344a75 00010000:00080000:1.0:1788587275.046359:0:17078:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf3abbe000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587275.046688:0:17078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788587275.048665:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310010496:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587275.048736:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587275.048855:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310010496 00000100:00100000:2.0:1788587275.048864:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310010496 00000100:00100000:2.0:1788587275.048914:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587275.048923:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310010496:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788587275.048954:0:16448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000040:01000000:1.0:1788587275.049328:0:17078:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788587275.049396:0:17078:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000020:00000080:2.0:1788587275.049890:0:16448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6344a7c 00000004:00100000:2.0:1788587275.049908:0:16448:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788587275.049921:0:16448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:1.0:1788587275.051447:0:17078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1788587275.052866:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587275.053142:0:17078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788587275.055099:0:17078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1788587275.055903:0:17083:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788587275.055912:0:17083:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788587275.056405:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587275.056416:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587275.056446:0:17078:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788587275.056464:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6344a83 00000100:00080000:3.0:1788587275.056473:0:17078:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587275.056479:0:17078:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cbf3abbe000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587275.056510:0:17078:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34a51c00 x1875469310010624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587275.056550:0:17078:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788587275.056745:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587275.056754:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587275.056756:0:17078:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788587275.056760:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587275.056763:0:17078:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788587275.056764:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587275.056766:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587275.056767:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587275.056769:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587275.056771:0:17078:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587275.056773:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587275.056777:0:17078:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:3.0:1788587275.056779:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587275.056781:0:17078:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788587275.056783:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587275.056786:0:17078:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:3.0:1788587275.056976:0:17078:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788587275.056979:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587275.056989:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8cbf33b0b380) 00000020:00000080:3.0:1788587275.057001:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788587275.057005:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587275.057115:0:17078:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788587275.057121:0:17078:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788587275.057126:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f6344a91 00010000:00080000:3.0:1788587275.057161:0:17078:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe03e18800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587275.057339:0:17078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788587275.057487:0:17078:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788587275.057504:0:17078:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788587275.058274:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310010624:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788587275.058321:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310010624 offset 0 length 520: 4 00000040:00080000:3.0:1788587275.062179:0:17078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587275.062257:0:17078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788587275.062328:0:17078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788587275.065162:0:17086:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788587275.065169:0:17086:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788587275.065858:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587275.065869:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788587275.065902:0:17078:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788587275.065923:0:17078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6344a98 00000100:00080000:0.0:1788587275.065933:0:17078:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587275.065939:0:17078:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cbe03e18800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587275.065971:0:17078:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0372df80 x1875469310010752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587275.065993:0:17078:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788587275.066161:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310010752:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788587275.066212:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310010752 offset 0 length 520: 4 00000020:01000000:0.0:1788587275.066430:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587275.066436:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.066438:0:17078:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788587275.066441:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587275.066445:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.066447:0:17078:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788587275.066450:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788587275.066452:0:17078:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788587275.066454:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587275.066456:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.066457:0:17078:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788587275.066460:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587275.066462:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.066463:0:17078:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788587275.066467:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788587275.066547:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587275.066551:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.066553:0:17078:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788587275.066556:0:17078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1788587275.068733:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788587275.068772:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788587275.069159:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.069180:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587275.069188:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe05dae000 from 1 10000000:01000000:3.0:1788587275.069191:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587275.069229:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.069237:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.069248:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587275.069271:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310010880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587275.069348:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.069391:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587275.069682:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310010880 00000100:00100000:0.0:1788587275.069690:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310010880 00000100:00100000:0.0:1788587275.069736:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587275.069745:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+15:17077:x1875469310010880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587275.069758:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587275.069771:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344a9f expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587275.069825:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 16 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587275.069837:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 16 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587275.069846:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26400, rc 0) 00000100:00100000:0.0:1788587275.069888:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+16:17077:x1875469310010880:12345-0@lo:101:mount.lustre.0 Request processed in 145us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587275.069895:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788587275.070870:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310010880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587275.073441:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.073456:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587275.074404:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011008:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788587275.074477:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.074531:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587275.074751:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310011008 00000100:00100000:2.0:1788587275.074758:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310011008 00000100:00100000:2.0:1788587275.074834:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788587275.074843:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+16:17077:x1875469310011008:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788587275.074862:0:16436:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788587275.074879:0:16436:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788587275.074882:0:16436:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788587275.074975:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+16:17077:x1875469310011008:12345-0@lo:256:mount.lustre.0 Request processed in 133us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.074983:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587275.075217:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011008:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788587275.075969:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587275.075990:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.076002:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587275.076140:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe05dae000 from 1 10000000:01000000:3.0:1788587275.076144:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587275.076176:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.076185:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.076194:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587275.076212:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587275.076255:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.076358:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587275.077139:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310011136 00000100:00100000:0.0:1788587275.077147:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310011136 00000100:00100000:0.0:1788587275.077226:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587275.077236:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+16:17077:x1875469310011136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587275.077250:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587275.077265:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344aad expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587275.077302:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 17 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587275.077314:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 17 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587275.077323:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27800, rc 0) 00000100:00100000:0.0:1788587275.077410:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011136:12345-0@lo:101:mount.lustre.0 Request processed in 176us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587275.077418:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587275.077479:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587275.077495:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.077504:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587275.077859:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587275.077894:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587275.077926:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.077961:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587275.078086:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310011264 00000100:00100000:1.0:1788587275.078091:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310011264 00000100:00100000:1.0:1788587275.078127:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587275.078134:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587275.078352:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011264:12345-0@lo:501:mount.lustre.0 Request processed in 218us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587275.078360:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587275.078469:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587275.079141:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587275.079187:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.079220:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf114d2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587275.079555:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310011392 00000100:00100000:2.0:1788587275.079561:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310011392 00000100:00100000:2.0:1788587275.079716:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587275.079726:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011392:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587275.079918:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011392:12345-0@lo:503:mount.lustre.0 Request processed in 193us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.079925:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587275.080709:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011392:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587275.081768:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587275.081899:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587275.081965:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587275.081998:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf034a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587275.082713:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310011520 00000100:00100000:2.0:1788587275.082721:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310011520 00000100:00100000:2.0:1788587275.082759:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587275.082767:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587275.082989:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011520:12345-0@lo:502:mount.lustre.0 Request processed in 221us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.082997:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587275.083255:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587275.083537:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788587275.083809:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788587275.083867:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788587275.083905:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788587275.083942:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788587275.083995:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788587275.084062:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788587275.084094:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788587275.084154:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788587275.084189:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788587275.084218:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788587275.084254:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587275.084315:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587275.084351:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf130e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587275.084457:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310011648 00000100:00100000:2.0:1788587275.084465:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310011648 00000100:00100000:2.0:1788587275.084502:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587275.084522:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587275.084959:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011648:12345-0@lo:502:mount.lustre.0 Request processed in 447us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.084967:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788587275.085101:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587275.085201:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788587275.085213:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788587275.086193:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587275.086203:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.086205:0:17088:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788587275.086211:0:17088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe05dae000 00000020:00000080:0.0:1788587275.086214:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587275.086220:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587275.086222:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.086224:0:17088:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788587275.086226:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587275.086229:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.086230:0:17088:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788587275.086234:0:17088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe05dae000 00000020:00000080:0.0:1788587275.086236:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587275.086287:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587275.086290:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.086292:0:17088:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788587275.086301:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587275.086304:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.086306:0:17088:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587275.086309:0:17088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe05dae000 00000020:00000080:0.0:1788587275.086311:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587275.086330:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587275.086333:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.086334:0:17088:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587275.086337:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587275.086339:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.086340:0:17088:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788587275.086344:0:17088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe05dae000 00000020:00000080:0.0:1788587275.086346:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587275.086378:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587275.086382:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587275.086383:0:17088:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788587275.086386:0:17088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1788587275.088870:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788587275.088910:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587275.088929:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587275.088942:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587275.088993:0:17077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788587275.088996:0:17077:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe05dae000 10000000:01000000:2.0:1788587275.088999:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe05dae000 10000000:01000000:2.0:1788587275.089003:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587275.089021:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe05dae000 from 1 10000000:01000000:2.0:1788587275.089024:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788587275.089062:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587275.089071:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587275.089082:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587275.089106:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587275.089180:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587275.089220:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587275.095874:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310011776 00000100:00100000:3.0:1788587275.095886:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310011776 00000100:00100000:3.0:1788587275.095942:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788587275.095952:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:17077:x1875469310011776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587275.095968:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587275.095985:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf2600/0x419e1ae1f6344ac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344abb expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.096024:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf2600/0x419e1ae1f6344ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344abb expref: 18 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.096036:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf3ccf2600/0x419e1ae1f6344ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344abb expref: 18 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.096045:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2600, rc 0) 00000100:00100000:3.0:1788587275.096118:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310011776:12345-0@lo:101:mount.lustre.0 Request processed in 168us (6939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.096126:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788587275.096193:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587275.096210:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.096220:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587275.097071:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788587275.097377:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587275.098177:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788587275.098227:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788587275.098262:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788587275.098323:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788587275.098363:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788587275.098412:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788587275.098449:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788587275.098484:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788587275.100772:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788587275.100857:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788587275.100888:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788587275.100930:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788587275.100963:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788587275.100994:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788587275.102206:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788587275.102255:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788587275.102292:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788587275.102340:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788587275.102376:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788587275.102410:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788587275.102474:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788587275.104402:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788587275.104483:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788587275.105151:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788587275.105196:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788587275.105231:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788587275.105281:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788587275.105315:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788587275.105403:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788587275.105411:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788587275.105526:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587275.107126:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.110713:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10d4b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587275.110742:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310011904 00000100:00100000:3.0:1788587275.110751:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310011904 00000100:00100000:2.0:1788587275.116152:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587275.116171:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310011904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587275.116465:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310011904:12345-0@lo:501:mount.lustre.0 Request processed in 300us (9343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.116474:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788587275.117065:0:16448:0:(import.c:65:import_set_state_nolock()) ffff8cbf10958800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587275.117121:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469310010496:12345-0@lo:38:llog_process_th.0 Request processed in 68198us (68385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.117130:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587275.118146:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310011904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587275.118197:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587275.118249:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587275.118281:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587275.118708:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587275.118717:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788587275.118725:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788587275.118730:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788587275.118734:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587275.118755:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310010496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587275.120132:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310012032 00000100:00100000:2.0:1788587275.120141:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310012032 00000100:00100000:2.0:1788587275.120187:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587275.120196:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587275.120397:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012032:12345-0@lo:503:mount.lustre.0 Request processed in 201us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.120405:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587275.120466:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587275.121670:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310012160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587275.121721:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587275.121775:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310012160 00000100:00100000:1.0:1788587275.121781:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310012160 00000100:00100000:1.0:1788587275.121829:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587275.121837:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3474:x1875469310012160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587275.121868:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587275.121910:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3474:x1875469310012160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587275.121917:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587275.121954:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310012160:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788587275.122335:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587275.122398:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587275.122449:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587275.122473:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587275.122488:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310012288 00000100:00100000:2.0:1788587275.122492:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310012288 00000100:00100000:2.0:1788587275.122530:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587275.122536:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587275.128478:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012288:12345-0@lo:502:mount.lustre.0 Request processed in 5933us (6020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.128492:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587275.128634:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587275.128898:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788587275.128944:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788587275.128970:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788587275.129018:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788587275.129049:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788587275.129105:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788587275.129135:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788587275.129161:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788587275.129197:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788587275.129225:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788587275.129251:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788587275.129288:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788587275.129316:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788587275.129342:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788587275.129384:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788587275.129414:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788587275.129439:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788587275.129474:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788587275.129500:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788587275.129543:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788587275.129581:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788587275.129621:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788587275.129653:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788587275.129701:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788587275.129729:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788587275.129761:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788587275.129831:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788587275.129868:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788587275.129899:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788587275.129941:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788587275.129977:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788587275.130009:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788587275.130043:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788587275.130102:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788587275.130140:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788587275.130186:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788587275.130221:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788587275.130270:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788587275.130328:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788587275.130379:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788587275.130413:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788587275.130444:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788587275.130491:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788587275.130540:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788587275.130575:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788587275.130623:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788587275.130659:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788587275.130689:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788587275.130752:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587275.130845:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587275.130886:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587275.131467:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310012416 00000100:00100000:3.0:1788587275.131475:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310012416 00000100:00100000:3.0:1788587275.131534:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587275.131553:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587275.131763:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012416:12345-0@lo:502:mount.lustre.0 Request processed in 211us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.131772:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587275.131847:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587275.131965:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788587275.132007:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788587275.132034:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587275.132071:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.132095:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310012544 00000100:00100000:3.0:1788587275.132105:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310012544 00000100:00100000:3.0:1788587275.132125:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788587275.132131:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587275.132231:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012544:12345-0@lo:502:mount.lustre.0 Request processed in 99us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.132238:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788587275.132267:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10d4b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587275.132278:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587275.132354:0:17077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788587275.132362:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788587275.135376:0:17093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788587275.135393:0:17093:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8cbf33b099c0) 00000020:00000080:3.0:1788587275.135418:0:17093:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788587275.135488:0:17093:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe05dae000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788587275.135492:0:17093:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe05dae000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788587275.135495:0:17093:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe05dae000 3 00010000:00080000:3.0:1788587275.135537:0:17093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf05220000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587275.138420:0:17093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788587275.138696:0:17093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788587275.138735:0:17093:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788587275.138747:0:17093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x419e1ae1f6344ad0 00000100:00080000:3.0:1788587275.138757:0:17093:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587275.138764:0:17093:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cbf05220000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587275.138817:0:17093:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34a51500 x1875469310012672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587275.138850:0:17093:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788587275.140378:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310012672:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587275.140452:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587275.140525:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310012672 00000100:00100000:2.0:1788587275.140547:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310012672 00000100:00100000:2.0:1788587275.140652:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587275.140661:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310012672:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788587275.140686:0:16442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:2.0:1788587275.140718:0:16442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x419e1ae1f6344ad7 00000004:00100000:2.0:1788587275.140921:0:16442:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788587275.140954:0:16442:0:(import.c:65:import_set_state_nolock()) ffff8cbf1095c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587275.141003:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1875469310012672:12345-0@lo:38:llog_process_th.0 Request processed in 341us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.141011:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788587275.141048:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf34a51500 x1875469310012672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587275.141059:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587275.141066:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788587275.141073:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788587275.141077:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788587275.141079:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587275.141085:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310012672:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788587275.141339:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788587275.141388:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788587275.141416:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587275.141437:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.141447:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788587275.141489:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587275.141491:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788587275.141492:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587275.141493:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587275.141495:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587275.141496:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587275.141497:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587275.141499:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587275.141505:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587275.141509:0:17077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788587275.141519:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587275.141520:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788587275.141521:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587275.141522:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587275.141523:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587275.141524:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587275.141525:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587275.141526:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587275.141527:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587275.141552:0:17077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788587275.141566:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012800:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587275.141784:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.141845:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310012800 00000100:00100000:3.0:1788587275.141851:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310012800 00000100:00100000:3.0:1788587275.141887:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788587275.141894:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cced450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17077:x1875469310012800:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587275.141918:0:16435:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788587275.141938:0:16435:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788587275.142266:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10d4b900 going to sleep for 11 seconds 20000000:01000000:3.0:1788587275.200122:0:16435:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788587275.200134:0:16435:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000001:00100000:3.0:1788587275.200156:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788587275.200172:0:16458:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788587275.200176:0:16458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788587275.200196:0:16458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.200214:0:16458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63449db expref: 18 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.200222:0:16458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 18 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.200229:0:16458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.200269:0:16458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 18 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.200283:0:16458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 18 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587275.200298:0:16458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310012928:0@lo:104: 00000100:00100000:3.0:1788587275.200361:0:16458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587275.200405:0:16458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63449db expref: 18 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.200413:0:16458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63449db expref: 18 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587275.200436:0:16458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310013056:0@lo:104: 00000100:00100000:3.0:1788587275.200459:0:16458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.200475:0:16458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587275.200525:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310012928 00000100:00100000:3.0:1788587275.200533:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310012928 00000100:00100000:3.0:1788587275.200562:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310013056 00000100:00100000:3.0:1788587275.200565:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310013056 00000100:00100000:3.0:1788587275.200578:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587275.201015:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:16458:x1875469310012928:12345-0@lo:104: 00010000:00010000:3.0:1788587275.201029:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201125:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587275.201131:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:16458:x1875469310012928:12345-0@lo:104: Request processed in 546us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.201138:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587275.201156:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587275.201163:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:16458:x1875469310013056:12345-0@lo:104: 00010000:00010000:3.0:1788587275.201171:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201205:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587275.201211:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:16458:x1875469310013056:12345-0@lo:104: Request processed in 49us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.201216:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788587275.201233:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587275.201238:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201252:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587275.201255:0:16430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201265:0:16430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587275.201272:0:16430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587275.201278:0:16430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587275.201306:0:16430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201313:0:16430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587275.201332:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201339:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344a9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344aa6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201364:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587275.201367:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201374:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587275.201376:0:16430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201392:0:16430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587275.201398:0:16430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587275.201403:0:16430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587275.201418:0:16430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201423:0:16430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587275.201438:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201446:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f63449db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449e2 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201457:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587275.201459:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587275.201461:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587275.201483:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310013184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587275.201527:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.201569:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310013312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587275.201604:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.201633:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310013184 00000100:00100000:3.0:1788587275.201637:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310013184 00010000:00010000:3.0:1788587275.201655:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 19 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587275.201687:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310013312 00000100:00100000:3.0:1788587275.201690:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310013312 00010000:00010000:3.0:1788587275.201701:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63449db expref: 20 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587275.201713:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587275.201719:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:3475:x1875469310013184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587275.201741:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587275.201746:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 20 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201757:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 20 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201773:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587275.201818:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:3475:x1875469310013184:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.201825:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587275.201836:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587275.201842:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:3472:x1875469310013312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587275.201849:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587275.201853:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63449db expref: 19 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201862:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63449db expref: 19 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201873:0:16427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201887:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587275.201901:0:16427:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003261985s 00010000:00010000:3.0:1788587275.201905:0:16427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201912:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201918:0:16427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201924:0:16427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201929:0:16427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587275.201933:0:16427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201940:0:16427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201948:0:16427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587275.201956:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587275.201982:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:3472:x1875469310013312:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.201987:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587275.202030:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310013312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587275.202055:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310013184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587275.202255:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587275.206090:0:16458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344aa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344a9f expref: 18 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587275.206113:0:16458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310012928:0@lo:104: 00010000:00010000:2.0:1788587275.206145:0:16458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f63449e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63449db expref: 17 pid: 16435 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587275.206155:0:16458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310013056:0@lo:104: 00010000:00010000:2.0:1788587275.206190:0:16458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587275.206200:0:16458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587275.206207:0:16458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587275.206214:0:16458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf3000/0x419e1ae1f6344ade lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587275.219858:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cced450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+16:17077:x1875469310012800:12345-0@lo:253:mount.lustre.0 Request processed in 77954us (78063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587275.219874:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788587275.219939:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17077:1875469310012800:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587275.219955:0:17077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788587275.219958:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587275.219960:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788587275.219962:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587275.219963:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587275.219964:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587275.219965:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587275.219967:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587275.219969:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587275.219970:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788587275.219985:0:17077:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788587275.225872:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587275.226417:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587275.226881:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587275.227022:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587275.227536:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587275.227928:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587275.230097:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587275.230263:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587275.230872:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587275.231008:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587275.231185:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587275.231355:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1788587275.234270:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788587275.234326:0:17102:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788587275.234331:0:17102:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788587275.235537:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:3.0:1788587275.235619:0:17103:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788587275.235711:0:17103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587275.238049:0:17104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17104:1875469310013440:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587275.238259:0:17104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587275.238296:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310013440 00000100:00100000:0.0:1788587275.238303:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310013440 00000040:01000000:1.0:1788587275.238386:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788587275.238524:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788587275.239324:0:17077:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788587275.239350:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788587275.239490:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587275.240302:0:17103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788587275.240359:0:17103:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788587275.240506:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587275.240530:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17104:x1875469310013440:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587275.240630:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17104:x1875469310013440:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587275.240637:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587275.240661:0:17104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587275.240685:0:17104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17104:1875469310013440:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788587275.240724:0:17104:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788587275.240759:0:17104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17104:1875469310013568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587275.240810:0:17104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587275.240833:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310013568 00000100:00100000:0.0:1788587275.240837:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310013568 00000040:00080000:1.0:1788587275.240838:0:17077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788587275.240859:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587275.240863:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17104:x1875469310013568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587275.240974:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17104:x1875469310013568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 109us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587275.240980:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587275.240993:0:17104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10cb50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587275.241004:0:17104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17104:1875469310013568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587275.241049:0:17104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17104:1875469310013696:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788587275.241074:0:17104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587275.241091:0:17104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10cb5240 going to sleep for 11 seconds 00000040:00080000:1.0:1788587275.241330:0:17077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788587275.241358:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788587275.241818:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310013696 00000100:00100000:3.0:1788587275.241825:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310013696 00000100:00100000:3.0:1788587275.241857:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587275.241866:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17104:x1875469310013696:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788587275.241918:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17104:x1875469310013696:12345-0@lo:900:lod0001_rec0000.0 Request processed in 54us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587275.241924:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788587275.241960:0:17104:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe0372ed80 x1875469310013696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587291 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587275.241979:0:17104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17104:1875469310013696:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788587275.242035:0:17104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17104:1875469310013824:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788587275.242212:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587275.242269:0:17104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587275.242323:0:17104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587275.242421:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310013824 00000100:00100000:0.0:1788587275.242426:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310013824 00000100:00100000:0.0:1788587275.242623:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587275.242632:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17104:x1875469310013824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587275.242695:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17104:x1875469310013824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 64us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587275.242701:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587275.242748:0:17104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17104:1875469310013824:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788587275.242788:0:17104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788587275.244674:0:17077:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/8/4) registered 00000040:00080000:3.0:1788587275.244885:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788587275.244944:0:17104:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788587275.244949:0:17104:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1788587275.251090:0:17077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788587275.277686:0:17077:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788587275.277736:0:17077:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb6254152f988 00100000:10000000:0.0:1788587275.277757:0:17077:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788587275.278906:0:17077:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788587275.278955:0:17077:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788587275.278976:0:17077:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788587275.279001:0:17077:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000100:00100000:0.0:1788587275.564741:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:0.0:1788587276.076580:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587276.203441:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788587276.459487:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788587276.587154:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 10000000:01000000:3.0:1788587276.778890:0:16439:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587276.778896:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe05dae000 from 8 10000000:01000000:3.0:1788587276.778900:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587276.778942:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587276.778953:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587276.778963:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587276.778988:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310013952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587276.779055:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587276.779106:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587276.779228:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310013952 00000100:00100000:0.0:1788587276.779244:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310013952 00000100:00100000:0.0:1788587276.779293:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587276.779301:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+16:16439:x1875469310013952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587276.779313:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587276.779326:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344ae5 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.779347:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 17 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.779357:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 17 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.779366:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26600, rc 0) 00000100:00100000:0.0:1788587276.779405:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310013952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587276.779411:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587276.779449:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310013952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587276.779462:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.779483:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587276.779538:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310014080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587276.779566:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587276.779579:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062aa600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587276.779592:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310014080 00000100:00100000:0.0:1788587276.779594:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310014080 00000100:00100000:0.0:1788587276.779613:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788587276.779618:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310014080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587276.779630:0:16435:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587276.779644:0:16435:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587276.779647:0:16435:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788587276.779709:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310014080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587276.779716:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788587276.779742:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310014080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587276.779810:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587276.779816:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.779824:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587276.779833:0:16439:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587276.779835:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe04f8d000 from 8 10000000:01000000:0.0:1788587276.779841:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587276.779855:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.779862:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.779870:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587276.779881:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310014208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587276.779902:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587276.780104:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062aa600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587276.780176:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310014208 00000100:00100000:0.0:1788587276.780180:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310014208 00000100:00100000:0.0:1788587276.780200:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788587276.780205:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310014208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587276.780212:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587276.780220:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344af3 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.780233:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 18 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.780242:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 18 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.780249:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27e00, rc 0) 00000100:00100000:0.0:1788587276.780273:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:16439:x1875469310014208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587276.780286:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788587276.780313:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310014208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587276.780323:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.780331:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587276.780365:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310014336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587276.780387:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587276.780399:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062aa600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587276.780408:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310014336 00000100:00100000:0.0:1788587276.780411:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310014336 00000100:00100000:0.0:1788587276.780427:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788587276.780432:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:16439:x1875469310014336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587276.780441:0:16435:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587276.780451:0:16435:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587276.780454:0:16435:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788587276.780994:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:16439:x1875469310014336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 559us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587276.781001:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788587276.781037:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310014336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587276.781076:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587276.781082:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587276.781098:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587277.099353:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587277.228751:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587277.616976:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:0.0:1788587278.122948:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587278.634878:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:0.0:1788587279.148641:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788587279.461444:0:17346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788587279.664517:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 0 seconds 00010000:00010000:1.0:1788587280.172596:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587280.427772:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310014464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587280.428000:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587280.428646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788587280.428651:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788587280.428655:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587280.428661:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1788587280.428666:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788587280.428672:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf05497800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587280.428693:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d57800 x1875469310014720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587280.428711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587280.428715:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587280.428718:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587280.428720:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587280.428734:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587280.428738:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587280.428740:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587280.428743:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788587280.428785:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310014592:0@lo:400:kworker.0 00000100:00100000:1.0:1788587280.428851:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587280.428882:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587280.428888:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310014848:0@lo:400:kworker.0 00000100:00100000:2.0:1788587280.428981:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310014976:0@lo:400:kworker.0 00000100:00100000:0.0:1788587280.428990:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310014464 00000100:00100000:0.0:1788587280.428998:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310014464 00000100:00100000:2.0:1788587280.429013:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587280.429037:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587280.429040:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310014976 00000100:00100000:0.0:1788587280.429045:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310014464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587280.429081:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587280.429115:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310014976 00000100:00100000:2.0:1788587280.429146:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587280.429152:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310014976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587280.429194:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310014976:12345-0@lo:400:kworker.0 Request processed in 42us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587280.429194:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310014464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587280.429202:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587280.429202:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587280.429222:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310014592 00000100:00100000:0.0:1788587280.429225:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310014592 00010000:00080000:2.0:1788587280.429235:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf35d56300 x1875469310014976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587280.429245:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587280.429247:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310014976:0@lo:400:kworker.0 00000100:00100000:0.0:1788587280.429251:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:3474:x1875469310014592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587280.429292:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:3474:x1875469310014592:12345-0@lo:400:kworker.0 Request processed in 41us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587280.429299:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788587280.429863:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310014720:0@lo:38:kworker.0 00000100:00100000:1.0:1788587280.430178:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587280.430223:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310014592:0@lo:400:kworker.0 00000100:00100000:1.0:1788587280.430253:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310014848 00000100:00100000:1.0:1788587280.430257:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310014848 00000100:00100000:1.0:1788587280.430296:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587280.430316:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587280.430986:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310014848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587280.431043:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310014848:12345-0@lo:400:kworker.0 Request processed in 740us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587280.431132:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587280.431204:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310014464:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1788587280.431234:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf35d54e00 x1875469310014848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587280.431245:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310014848:0@lo:400:kworker.0 00000100:00100000:2.0:1788587280.431845:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310014720 00000100:00100000:2.0:1788587280.431852:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310014720 00000100:00100000:2.0:1788587280.431881:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587280.431889:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310014720:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788587280.431914:0:16448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1788587280.433056:0:16448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6344b01 00000004:00100000:2.0:1788587280.433077:0:16448:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788587280.433084:0:16448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788587280.476252:0:16448:0:(import.c:65:import_set_state_nolock()) ffff8cbf41b12800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587280.476337:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469310014720:12345-0@lo:38:kworker.0 Request processed in 44446us (46018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587280.476360:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587280.476410:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788587280.476419:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788587280.476427:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788587280.476432:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788587280.476434:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788587280.476448:0:3471:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000eaeddc34): req@ffff8cbf35d55500 x1875469310007936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587280.476464:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310014720:0@lo:38:kworker.0 00000100:00100000:0.0:1788587280.476575:0:16485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587280.476597:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34390f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587280.476611:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310015104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587280.476630:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587280.476657:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310007936 00000100:00100000:0.0:1788587280.476662:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310007936 00000100:00100000:0.0:1788587280.476684:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310015104 00000100:00100000:0.0:1788587280.477086:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310015104 00000100:00100000:0.0:1788587280.477109:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587280.477115:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16485:x1875469310007936:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587280.477187:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16485:x1875469310007936:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587280.477194:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587280.477206:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587280.477212:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469310015104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587280.477234:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587280.477276:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469310015104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587280.477282:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587280.477312:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310015104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587280.477348:0:16485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16485:1875469310007936:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788587280.477380:0:16485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788587280.477411:0:16485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16485:1875469310015232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587280.477439:0:16485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587280.477463:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587280.477486:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310015232 00000100:00100000:0.0:1788587280.477489:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310015232 00000100:00100000:0.0:1788587280.477506:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587280.477511:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16485:x1875469310015232:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587280.477622:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16485:x1875469310015232:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587280.477628:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587280.477652:0:16485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16485:1875469310015232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587280.477713:0:16485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16485:1875469310015360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587280.477734:0:16485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587280.477748:0:16485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587280.477758:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310015360 00000100:00100000:0.0:1788587280.477762:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310015360 00000100:00100000:0.0:1788587280.477779:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587280.477784:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16485:x1875469310015360:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587280.477847:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16485:x1875469310015360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587280.477861:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587280.477886:0:16485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16485:1875469310015360:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788587280.477921:0:16485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587280.485154:0:16485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788587280.485237:0:16485:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 16, retries 0 00000004:00080000:0.0:1788587280.485242:0:16485:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788587281.196058:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587282.157038:0:17499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd98f68de0 20000000:00000080:2.0:1788587282.157237:0:17499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbf05894c00 uarg=0000000000000000 20000000:01000000:2.0:1788587282.157401:0:17499:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788587282.157408:0:17499:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788587282.157413:0:17499:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788587282.159582:0:17500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788587282.159739:0:17499:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788587282.167184:0:17499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788587282.167213:0:17499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.167234:0:17499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 17 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.167257:0:17499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 17 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.167264:0:17499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.167306:0:17499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 17 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.167321:0:17499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 17 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587282.167335:0:17499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17499:1875469310015488:0@lo:104: 00000100:00100000:1.0:1788587282.167397:0:17499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587282.167451:0:17499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 17 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.167460:0:17499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 17 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587282.167478:0:17499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17499:1875469310015616:0@lo:104: 00000100:00100000:1.0:1788587282.167499:0:17499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587282.167560:0:17499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062aa600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587282.169024:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310015488 00000100:00100000:2.0:1788587282.169035:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310015488 00000100:00100000:2.0:1788587282.169073:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310015616 00000100:00100000:2.0:1788587282.169076:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310015616 00000100:00100000:2.0:1788587282.169093:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587282.169102:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:17499:x1875469310015488:12345-0@lo:104: 00010000:00010000:2.0:1788587282.169228:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587282.169370:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587282.169377:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:17499:x1875469310015488:12345-0@lo:104: Request processed in 276us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587282.169384:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587282.169403:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587282.169410:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:17499:x1875469310015616:12345-0@lo:104: 00010000:00010000:2.0:1788587282.169417:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587282.169458:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587282.169473:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:17499:x1875469310015616:12345-0@lo:104: Request processed in 55us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587282.169479:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788587282.169526:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587282.169534:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169541:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587282.169545:0:16430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169554:0:16430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587282.169562:0:16430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587282.169568:0:16430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587282.169609:0:16430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169616:0:16430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587282.169635:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169642:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3a00/0x419e1ae1f6344aad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344ab4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169669:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587282.169672:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169690:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587282.169693:0:16430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169699:0:16430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587282.169704:0:16430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587282.169708:0:16430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587282.169721:0:16430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169726:0:16430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587282.169733:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169739:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f63449aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63449b1 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.169754:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587282.169755:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587282.169757:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587282.169769:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310015744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587282.169829:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587282.170173:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587282.170181:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310015872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587282.170205:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587282.170252:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310015744 00000100:00100000:0.0:1788587282.170256:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310015744 00010000:00010000:0.0:1788587282.170275:0:16428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 18 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587282.170293:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310015872 00000100:00100000:0.0:1788587282.170295:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310015872 00010000:00010000:0.0:1788587282.170304:0:16428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 19 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587282.170314:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587282.170321:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:3474:x1875469310015744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587282.170332:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587282.170337:0:16428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 19 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170349:0:16428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 19 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170364:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587282.170390:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:3474:x1875469310015744:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587282.170397:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587282.170409:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587282.170414:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:3474:x1875469310015872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587282.170427:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587282.170431:0:16428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 18 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170440:0:16428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 18 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170451:0:16428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170459:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170481:0:16428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170488:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170495:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170501:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170507:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587282.170510:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170518:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170534:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587282.170543:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587282.170562:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:3474:x1875469310015872:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587282.170569:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587282.170598:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310015872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587282.170605:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310015744:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587282.170705:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587282.171046:0:17499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344ab4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344aad expref: 17 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587282.171059:0:17499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17499:1875469310015488:0@lo:104: 00010000:00010000:1.0:1788587282.171068:0:17499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf2800/0x419e1ae1f63449b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63449aa expref: 16 pid: 16437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587282.171086:0:17499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17499:1875469310015616:0@lo:104: 00010000:00010000:1.0:1788587282.171102:0:17499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.171173:0:17499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.171180:0:17499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.171187:0:17499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6344b08 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587282.224223:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587283.242863:0:16439:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587283.242873:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe05dae000 from 13 10000000:01000000:2.0:1788587283.242878:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587283.242923:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.242935:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.242955:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587283.242980:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587283.243040:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587283.243077:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf20affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587283.243095:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310016000 00000100:00100000:2.0:1788587283.243101:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310016000 00000100:00100000:2.0:1788587283.243144:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788587283.243153:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+16:16439:x1875469310016000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587283.243165:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587283.243177:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344b0f expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.243201:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 17 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.243211:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 17 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.243220:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae400, rc 0) 00000100:00100000:2.0:1788587283.243255:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310016000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587283.243261:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:2.0:1788587283.243394:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587283.243418:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587283.243433:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.243527:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587283.243594:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587283.243622:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587283.243640:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf20affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587283.243764:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310016128 00000100:00100000:2.0:1788587283.243769:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310016128 00000100:00100000:2.0:1788587283.243814:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587283.243821:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310016128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587283.244055:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310016128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587283.244063:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587283.244101:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587283.244129:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587283.244167:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587283.244189:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf20affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587283.244201:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310016256 00000100:00100000:2.0:1788587283.244204:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310016256 00000100:00100000:2.0:1788587283.244227:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587283.244235:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310016256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587283.245853:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310016256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1612us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587283.245864:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587283.245938:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587283.248017:0:17560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788587283.248145:0:16439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788587283.248166:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587283.248175:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587283.248187:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587283.248197:0:16439:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587283.248199:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe04f8d000 from 13 10000000:01000000:1.0:1788587283.248202:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587283.248233:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587283.248241:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587283.248259:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587283.248278:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587283.248340:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587283.248377:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10cb56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587283.249085:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310016384 00000100:00100000:2.0:1788587283.249093:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310016384 00000100:00100000:2.0:1788587283.249276:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788587283.249285:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+17:16439:x1875469310016384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587283.249420:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587283.249550:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344b1d expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.249577:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 18 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.249588:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 18 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.249596:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe062ae800, rc 0) 00000100:00100000:2.0:1788587283.249710:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:16439:x1875469310016384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 425us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587283.249717:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587283.249755:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587283.249777:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587283.249788:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587283.252232:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587283.252295:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587283.252392:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310016512 00000100:00100000:2.0:1788587283.252401:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310016512 00000100:00100000:2.0:1788587283.252619:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788587283.252629:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:16439:x1875469310016512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587283.252974:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:16439:x1875469310016512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587283.252983:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587283.253972:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083f0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587283.254016:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587283.254074:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587283.254125:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587283.254150:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083f0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587283.254168:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310016640 00000100:00100000:0.0:1788587283.254178:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310016640 00000100:00100000:0.0:1788587283.254213:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788587283.254221:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:16439:x1875469310016640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587283.254513:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:16439:x1875469310016640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 292us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587283.254522:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788587283.255771:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310016640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587283.256938:0:17561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788587283.257252:0:16439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788587283.257286:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587283.257307:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587283.257319:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587284.268051:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587285.292887:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587285.547029:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310016768:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788587285.547075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587285.547080:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587285.547083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587285.547087:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587285.547101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587285.547104:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587285.547107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587285.547109:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788587285.547147:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587285.547195:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310017280:0@lo:400:kworker.0 00000100:00100000:3.0:1788587285.547208:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310017024:0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.547244:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587285.547253:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587285.547271:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788587285.547282:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310016896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587285.547290:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310017536:0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.547314:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587285.547335:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587285.547356:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310017408:0@lo:400:kworker.0 00000100:00100000:3.0:1788587285.547358:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587285.547367:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310017152:0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.547386:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587285.547402:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587285.547425:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310016768 00000100:00100000:0.0:1788587285.547433:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310016768 00000100:00100000:3.0:1788587285.547435:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310017024 00000100:00100000:3.0:1788587285.547448:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310017024 00000100:00100000:0.0:1788587285.547485:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310016896 00000100:00100000:0.0:1788587285.547490:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310016896 00000100:00100000:3.0:1788587285.547494:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788587285.547505:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:3474:x1875469310017024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.547522:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310017408 00000100:00100000:0.0:1788587285.547527:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310017408 00000100:00100000:3.0:1788587285.547553:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:3474:x1875469310017024:12345-0@lo:400:kworker.0 Request processed in 50us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587285.547554:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310017152 00000100:00100000:0.0:1788587285.547559:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310017152 00000100:00100000:3.0:1788587285.547564:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788587285.547577:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788587285.547587:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3472:x1875469310016768:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587285.547597:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310017280 00000100:00100000:3.0:1788587285.547612:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310017280 00000004:00000024:0.0:1788587285.547621:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587285.547637:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310017536 00000100:00100000:3.0:1788587285.547641:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310017536 00000100:00100000:3.0:1788587285.547655:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587285.547661:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310017280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.547691:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3472:x1875469310016768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587285.547700:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587285.547704:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310017280:12345-0@lo:400:kworker.0 Request processed in 42us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587285.547712:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587285.547724:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587285.547730:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587285.547735:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3472:x1875469310016896:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587285.547742:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310017536:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1788587285.547760:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788587285.547768:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310017536:12345-0@lo:400:kworker.0 Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587285.547774:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587285.547831:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310017024:0@lo:400:kworker.0 00010000:00080000:3.0:1788587285.547846:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf34a52680 x1875469310017536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587285.547857:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3472:x1875469310016896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587285.547862:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310017536:0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.547868:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587285.547889:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587285.547897:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310017408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.547929:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310017408:12345-0@lo:400:kworker.0 Request processed in 33us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587285.547936:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587285.547951:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587285.547958:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469310017152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.548005:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469310017152:12345-0@lo:400:kworker.0 Request processed in 47us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587285.548011:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587285.548048:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310016896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587285.548059:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310017408:0@lo:400:kworker.0 00010000:00080000:0.0:1788587285.548068:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf34a51880 x1875469310017280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587285.548078:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310017280:0@lo:400:kworker.0 00000100:00100000:0.0:1788587285.548101:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310016768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587285.548194:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310017152:0@lo:400:kworker.0 00000100:00100000:2.0:1788587285.548370:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587275/real 1788587275] req@ffff8cbe0372df80 x1875469310010752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587285 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587285.548387:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe0372df80 x1875469310010752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587285 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587285.548397:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587275/real 1788587275] req@ffff8cbf34a51c00 x1875469310010624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587285 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587285.548407:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf34a51c00 x1875469310010624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587285 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587285.548420:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e18800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587285.548432:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587285.548435:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310010752:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788587285.548439:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbe000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587285.548455:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587285.548458:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310010624:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788587285.548942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587285.548947:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587285.548957:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587285.548959:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587285.548962:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587285.548964:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788587285.548966:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbe000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587285.548971:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1788587285.548975:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587285.548980:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cbf3abbe000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587285.549003:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03d9e300 x1875469310017664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587285.549017:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587285.549020:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587285.549021:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e18800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587285.549024:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1788587285.549026:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587285.549029:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cbe03e18800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587285.549038:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03d9c000 x1875469310017792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587285.549058:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310017664:0@lo:8:kworker.0 00000400:00000100:2.0:1788587285.549122:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310017664 offset 0 length 520: 4 00000100:00100000:2.0:1788587285.549147:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310017792:0@lo:8:kworker.0 00000400:00000100:2.0:1788587285.549163:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310017792 offset 0 length 520: 4 00000001:00100000:0.0:1788587285.647979:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788587286.319998:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788587286.587446:0:17749:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587286.587459:0:17749:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788587286.588151:0:17749:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbf1095e800 00000020:01000004:2.0:1788587286.588169:0:17749:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788587286.588183:0:17749:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788587286.588198:0:17749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cbf062bb380) 00000020:00000080:2.0:1788587286.588213:0:17749:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788587286.611953:0:17749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788587286.612732:0:17749:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788587286.613785:0:17749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788587286.614160:0:17749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788587286.614355:0:17749:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788587286.614992:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 119: rc = 0 00100000:10000000:1.0:1788587286.615171:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 119: rc = 0 00100000:10000000:1.0:1788587286.615327:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 119: rc = 0 00100000:10000000:1.0:1788587286.616173:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 643: rc = 0 00100000:10000000:1.0:1788587286.616520:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:1.0:1788587286.617092:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:1.0:1788587286.617344:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:1.0:1788587286.617914:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 643: rc = 0 00100000:10000000:1.0:1788587286.618944:0:17749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 643: rc = 0 00000020:00000080:1.0:1788587286.619908:0:17749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788587286.619927:0:17749:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788587286.619938:0:17749:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x419e1ae1f6344b32 00000020:01000004:1.0:1788587286.619946:0:17749:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788587286.619968:0:17749:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788587286.619973:0:17749:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788587286.619978:0:17749:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788587286.619984:0:17749:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788587286.619995:0:17749:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cbf181a19c0) 00000020:00000080:1.0:1788587286.620007:0:17749:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788587286.625242:0:17749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587286.626149:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788587286.626159:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788587286.627116:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788587286.627126:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788587286.628623:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587286.628635:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788587286.633266:0:17749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587286.634117:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788587286.634126:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788587286.649598:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587286.649748:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788587286.693058:0:17749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587286.693411:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788587286.693418:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788587286.695463:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788587286.695545:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788587286.696648:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587286.696658:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788587286.699893:0:17749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587286.700087:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788587286.700094:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000040:00080000:3.0:1788587286.701736:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587286.702163:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788587286.702174:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788587286.743974:0:17749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587286.744316:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788587286.744323:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788587286.745736:0:17749:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788587286.746403:0:17749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788587286.747247:0:17749:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788587286.747326:0:17749:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788587286.747333:0:17749:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788587286.765057:0:17749:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788587286.765096:0:17749:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788587286.765100:0:17749:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788587286.765102:0:17749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587286.765104:0:17749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587286.765105:0:17749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587286.765106:0:17749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587286.765107:0:17749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587286.765109:0:17749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587286.765111:0:17749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587286.765112:0:17749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587286.765115:0:17749:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788587286.765122:0:17749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587286.765123:0:17749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587286.765124:0:17749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587286.765125:0:17749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587286.765126:0:17749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587286.765127:0:17749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587286.765127:0:17749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587286.765129:0:17749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587286.765129:0:17749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587286.765166:0:17749:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788587286.765187:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310017920:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587286.765419:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587286.765568:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310017920 00000100:00100000:0.0:1788587286.765577:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310017920 00000100:00100000:0.0:1788587286.765635:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788587286.765645:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17749:x1875469310017920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587286.765673:0:16435:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788587286.765676:0:16435:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788587286.765679:0:16435:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788587286.765998:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02458240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587286.776119:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17749:x1875469310017920:12345-0@lo:253:mount.lustre.0 Request processed in 10467us (10691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587286.776131:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587286.776214:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310017920:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587286.776228:0:17749:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788587286.776231:0:17749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587286.776232:0:17749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587286.776233:0:17749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587286.776234:0:17749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587286.776235:0:17749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587286.776236:0:17749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587286.776237:0:17749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587286.776239:0:17749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587286.776240:0:17749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788587286.776260:0:17749:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbf1095e800 from lustre-OST0000 10000000:01000000:1.0:1788587286.776283:0:17749:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788587286.776286:0:17749:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788587286.776293:0:17749:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf41a34d40 local copy 00010000:00010000:1.0:1788587286.776303:0:17749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587286.776536:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587286.776571:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.776610:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03539a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587286.776635:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310018048 00000100:00100000:3.0:1788587286.776642:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310018048 00000100:00100000:3.0:1788587286.776734:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788587286.776744:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17749:x1875469310018048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587286.777046:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17749:x1875469310018048:12345-0@lo:501:mount.lustre.0 Request processed in 303us (473us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587286.777054:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587286.777068:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018048:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788587286.777143:0:17749:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788587286.777294:0:17749:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788587286.777302:0:17749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587286.777311:0:17749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587286.777493:0:17749:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbf1095e800 10000000:01000000:1.0:1788587286.777497:0:17749:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788587286.777502:0:17749:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788587286.777505:0:17749:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587286.777509:0:17749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788587286.777512:0:17749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788587286.777535:0:17749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587286.777544:0:17749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587286.777553:0:17749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587286.777566:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587286.777595:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.777667:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03539a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587286.777752:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310018176 00000100:00100000:0.0:1788587286.777757:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310018176 00000100:00100000:0.0:1788587286.777856:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788587286.777865:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+18:17749:x1875469310018176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587286.777875:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587286.777889:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26c00/0x419e1ae1f6344b47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344b40 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.777910:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26c00/0x419e1ae1f6344b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344b40 expref: 19 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.777921:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26c00/0x419e1ae1f6344b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344b40 expref: 19 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.777929:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26c00, rc 0) 00000100:00100000:0.0:1788587286.778012:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018176:12345-0@lo:101:mount.lustre.0 Request processed in 148us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587286.778018:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587286.778074:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587286.778087:0:17749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587286.778102:0:17749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587286.779131:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788587286.781163:0:17749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587286.781429:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788587286.781493:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788587286.781528:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788587286.781579:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788587286.781617:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788587286.781727:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788587286.781834:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788587286.781845:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788587286.781932:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587286.781998:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.782040:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03539480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587286.784444:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310018304 00000100:00100000:3.0:1788587286.784472:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310018304 00000100:00100000:3.0:1788587286.784715:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788587286.784727:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587286.793335:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018304:12345-0@lo:501:mount.lustre.0 Request processed in 8601us (11328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587286.793349:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587286.793503:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587286.793569:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587286.793625:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.793768:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03539480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587286.797057:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310018432 00000100:00100000:0.0:1788587286.797072:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310018432 00000100:00100000:0.0:1788587286.797130:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788587286.797141:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018432:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587286.798244:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587286.798368:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018432:12345-0@lo:503:mount.lustre.0 Request processed in 1047us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587286.798378:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000040:00080000:1.0:1788587286.799298:0:17749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587286.799381:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587286.799450:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.799496:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03539480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587286.799625:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310018560 00000100:00100000:3.0:1788587286.799631:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310018560 00000100:00100000:3.0:1788587286.799745:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788587286.799754:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587286.799997:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018560:12345-0@lo:502:mount.lustre.0 Request processed in 244us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587286.800005:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587286.801531:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587286.801923:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788587286.801989:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788587286.802026:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788587286.802074:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788587286.802113:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788587286.802149:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788587286.802202:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788587286.802240:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788587286.802276:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788587286.802327:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788587286.802364:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788587286.802417:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788587286.802471:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587286.802546:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.802591:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03539480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587286.802846:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310018688 00000100:00100000:0.0:1788587286.802854:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310018688 00000100:00100000:0.0:1788587286.802906:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788587286.802914:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587286.803108:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018688:12345-0@lo:502:mount.lustre.0 Request processed in 194us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587286.803117:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587286.803235:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587286.803313:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788587286.803326:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788587286.805756:0:17763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587286.805768:0:17763:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788587286.805774:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587286.805777:0:17763:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788587286.805782:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587286.805827:0:17763:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cbf181a4d40) 00000020:00000080:1.0:1788587286.805868:0:17763:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788587286.805875:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788587286.805939:0:17763:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf1095e800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788587286.805948:0:17763:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788587286.805955:0:17763:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x419e1ae1f6344b55 00010000:00010000:1.0:1788587286.809066:0:17763:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788587286.820249:0:17763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788587286.823987:0:17763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788587286.830991:0:17763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788587286.831004:0:17763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587286.831011:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587286.831014:0:17763:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788587286.831017:0:17763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587286.831020:0:17763:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788587286.831022:0:17763:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587286.831023:0:17763:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587286.831025:0:17763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587286.831028:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587286.831035:0:17763:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587286.831039:0:17763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587286.831042:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587286.831044:0:17763:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788587286.831047:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788587286.831049:0:17763:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788587286.831051:0:17763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587286.831053:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587286.831054:0:17763:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788587286.831056:0:17763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587286.831058:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587286.831060:0:17763:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788587286.831063:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788587286.831140:0:17763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587286.831144:0:17763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587286.831145:0:17763:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788587286.831148:0:17763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788587286.832590:0:17749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788587286.832629:0:17749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788587286.832649:0:17749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587286.832662:0:17749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587286.832671:0:17749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf1095e800 from 1 10000000:01000000:3.0:1788587286.832674:0:17749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587286.832709:0:17749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587286.832718:0:17749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587286.832741:0:17749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587286.832765:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587286.832849:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.832893:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587286.832956:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310018816 00000100:00100000:0.0:1788587286.832963:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310018816 00000100:00100000:0.0:1788587286.833006:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788587286.833015:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310018816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587286.833027:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587286.833039:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344b5c expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.833063:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 20 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.833084:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 20 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.833104:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27800, rc 0) 00000100:00100000:0.0:1788587286.833142:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310018816:12345-0@lo:101:mount.lustre.0 Request processed in 128us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587286.833149:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788587286.833231:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587286.833245:0:17749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587286.833255:0:17749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587286.834289:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788587286.835038:0:17749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587286.835256:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788587286.835301:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788587286.835380:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788587286.835388:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788587286.835472:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587286.835938:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.836010:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587286.852494:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310018944 00000100:00100000:2.0:1788587286.852510:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310018944 00000100:00100000:2.0:1788587286.852575:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788587286.852584:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310018944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587286.856397:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310018944:12345-0@lo:501:mount.lustre.0 Request processed in 3804us (20449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587286.856412:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788587286.858411:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310018944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587286.858478:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587286.858617:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.858695:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587286.858947:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310019072 00000100:00100000:2.0:1788587286.858954:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310019072 00000100:00100000:2.0:1788587286.859000:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788587286.859010:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310019072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587286.859465:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310019072:12345-0@lo:503:mount.lustre.0 Request processed in 454us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587286.859473:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788587286.859570:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587286.860384:0:17749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587286.860466:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587286.860853:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.860886:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587286.860976:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310019200 00000100:00100000:2.0:1788587286.860982:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310019200 00000100:00100000:2.0:1788587286.861018:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587286.861025:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310019200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587286.861185:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310019200:12345-0@lo:502:mount.lustre.0 Request processed in 159us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587286.861192:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788587286.861314:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587286.861623:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788587286.861671:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788587286.861722:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788587286.861760:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788587286.861825:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788587286.861883:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788587286.861922:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788587286.861955:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788587286.862003:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788587286.862039:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788587286.862071:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788587286.862182:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587286.862229:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.862252:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587286.862321:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310019328 00000100:00100000:2.0:1788587286.862326:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310019328 00000100:00100000:2.0:1788587286.862364:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788587286.862372:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310019328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587286.862640:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310019328:12345-0@lo:502:mount.lustre.0 Request processed in 267us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587286.862647:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587286.862832:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587286.862915:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788587286.862926:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788587286.870935:0:17767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587286.870955:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587286.870958:0:17767:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788587286.870968:0:17767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf1095e800 00000020:00000080:0.0:1788587286.870970:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587286.870982:0:17767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587286.870985:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587286.870986:0:17767:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788587286.870989:0:17767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587286.870991:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587286.870993:0:17767:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788587286.870996:0:17767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf1095e800 00000020:00000080:0.0:1788587286.870998:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587286.871083:0:17767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587286.871088:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587286.871089:0:17767:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788587286.871092:0:17767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587286.871095:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587286.871097:0:17767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587286.871101:0:17767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf1095e800 00000020:00000080:0.0:1788587286.871103:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587286.871122:0:17767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587286.871126:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587286.871135:0:17767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587286.871139:0:17767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587286.871142:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587286.871143:0:17767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788587286.871146:0:17767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf1095e800 00000020:00000080:0.0:1788587286.871148:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587286.871187:0:17767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587286.871191:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587286.871194:0:17767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788587286.871198:0:17767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788587286.871383:0:17749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788587286.871441:0:17749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587286.871467:0:17749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587286.871508:0:17749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587286.871561:0:17749:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788587286.871565:0:17749:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbf1095e800 10000000:01000000:3.0:1788587286.871568:0:17749:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbf1095e800 10000000:01000000:3.0:1788587286.871573:0:17749:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587286.871578:0:17749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf1095e800 from 1 10000000:01000000:3.0:1788587286.871581:0:17749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587286.871617:0:17749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587286.871626:0:17749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587286.871637:0:17749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587286.871660:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587286.871738:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.871786:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587286.872495:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310019456 00000100:00100000:0.0:1788587286.872511:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310019456 00000100:00100000:0.0:1788587286.873365:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587286.873383:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:17749:x1875469310019456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587286.873406:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587286.873441:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f6344b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344b6a expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.873480:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f6344b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344b6a expref: 21 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.873493:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f6344b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344b6a expref: 21 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587286.873504:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27a00, rc 0) 00000100:00100000:0.0:1788587286.873601:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019456:12345-0@lo:101:mount.lustre.0 Request processed in 225us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587286.873611:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587286.876553:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587286.876591:0:17749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587286.876607:0:17749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587286.877362:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788587286.877720:0:17749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587286.877979:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788587286.878021:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788587286.878052:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788587286.878094:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788587286.878125:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788587286.878177:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788587286.878219:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788587286.878250:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788587286.878309:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788587286.878341:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788587286.878371:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788587286.878414:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788587286.878465:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788587286.878529:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788587286.878588:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788587286.878625:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788587286.878650:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788587286.878687:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788587286.878720:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788587286.878755:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788587286.878827:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788587286.878863:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788587286.878895:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788587286.878946:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788587286.879005:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788587286.879042:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788587286.879117:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788587286.879164:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788587286.879207:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788587286.879271:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788587286.879299:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788587286.879324:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788587286.879349:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788587286.879418:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788587286.881627:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788587286.881756:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788587286.881819:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788587286.882583:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788587286.882595:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788587286.884774:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587286.885450:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.885504:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587286.885740:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310019584 00000100:00100000:2.0:1788587286.885756:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310019584 00000100:00100000:2.0:1788587286.885840:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587286.885853:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587286.886178:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019584:12345-0@lo:501:mount.lustre.0 Request processed in 327us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587286.886188:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788587286.886231:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587286.886430:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587286.886511:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.886561:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310019712 00000100:00100000:3.0:1788587286.886567:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587286.886570:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310019712 00000100:00100000:1.0:1788587286.887733:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788587286.887754:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587286.888582:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019712:12345-0@lo:503:mount.lustre.0 Request processed in 829us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587286.888938:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587286.889736:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000040:00080000:3.0:1788587286.891191:0:17749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587286.891393:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587286.891509:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.891577:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587286.892786:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310019840 00000100:00100000:1.0:1788587286.892822:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310019840 00000100:00100000:1.0:1788587286.892894:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788587286.892906:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587286.893352:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019840:12345-0@lo:502:mount.lustre.0 Request processed in 446us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587286.893361:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788587286.897153:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587286.897597:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788587286.897677:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788587286.897715:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788587286.897767:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788587286.899481:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788587286.899589:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788587286.899635:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788587286.899670:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788587286.899722:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788587286.899761:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788587286.899822:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788587286.901156:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788587286.901249:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788587286.901958:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788587286.902048:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788587286.902099:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788587286.902141:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788587286.902192:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788587286.902230:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788587286.902263:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788587286.902356:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788587286.902393:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788587286.902423:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788587286.902497:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788587286.902537:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788587286.902574:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788587286.902638:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788587286.902677:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788587286.902709:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788587286.902762:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788587286.902849:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788587286.902896:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788587286.902946:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788587286.903012:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788587286.903053:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788587286.903131:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788587286.903186:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788587286.903238:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788587286.903305:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788587286.903356:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788587286.903400:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788587286.904954:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788587286.909877:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788587286.909987:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788587286.910033:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788587286.919213:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788587286.919294:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788587286.919332:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788587286.919425:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587286.919562:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.919627:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310019968 00000100:00100000:3.0:1788587286.919637:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310019968 00000100:00100000:3.0:1788587286.919704:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587286.919714:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587286.920411:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310019968:12345-0@lo:502:mount.lustre.0 Request processed in 694us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587286.920420:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587286.920491:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587286.920518:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310019968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587286.920687:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788587286.920733:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788587286.921029:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310020096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587286.921077:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587286.921166:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587286.921267:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310020096 00000100:00100000:2.0:1788587286.921274:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310020096 00000100:00100000:2.0:1788587286.921354:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587286.921364:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310020096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587286.921591:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310020096:12345-0@lo:502:mount.lustre.0 Request processed in 228us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587286.921611:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587286.921715:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310020096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587286.921885:0:17749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788587286.922062:0:17749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788587286.923837:0:17772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788587286.924338:0:17772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cbe037a99c0) 00000020:00000080:0.0:1788587286.924369:0:17772:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788587286.924475:0:17772:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf1095e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788587286.924480:0:17772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf1095e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788587286.924483:0:17772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf1095e800 3 00010000:00080000:0.0:1788587286.924516:0:17772:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe044fa000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.114@tcp at head 00010000:00010000:0.0:1788587286.929430:0:17772:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788587286.929774:0:17772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788587286.929844:0:17772:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788587286.929924:0:17772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x419e1ae1f6344b7f 00000100:00080000:0.0:1788587286.929938:0:17772:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587286.929946:0:17772:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbe044fa000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587286.929995:0:17772:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0586e680 x1875469310020224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587286.930074:0:17772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788587286.930461:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310020224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587286.930551:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.930671:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310020224 00000100:00100000:1.0:1788587286.930682:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310020224 00000100:00100000:1.0:1788587286.930729:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587286.930740:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310020224:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788587286.930789:0:16443:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1788587286.930871:0:16443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x419e1ae1f6344b86 00000004:00100000:1.0:1788587286.930892:0:16443:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587286.931172:0:16443:0:(import.c:65:import_set_state_nolock()) ffff8cbe0362e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587286.931250:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1875469310020224:12345-0@lo:38:llog_process_th.0 Request processed in 511us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587286.931259:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788587286.931363:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe0586e680 x1875469310020224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587286.931375:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587286.931385:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788587286.931394:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587286.931400:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788587286.931403:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587286.931409:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310020224:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788587286.932062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587286.932068:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587286.932079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587286.932083:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587286.932115:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587286.932118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587286.932121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587286.932124:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788587286.932158:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310020352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587286.932208:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.932239:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587286.932244:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310020736:0@lo:400:kworker.0 00000100:00100000:1.0:1788587286.932274:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.932315:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310020480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587286.932339:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.932358:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587286.932362:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310020608:0@lo:400:kworker.0 00000100:00100000:1.0:1788587286.932383:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.932423:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310020352 00000100:00100000:1.0:1788587286.932430:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310020352 00000100:00100000:1.0:1788587286.932474:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310020608 00000100:00100000:1.0:1788587286.932476:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310020608 00000100:00100000:1.0:1788587286.932490:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587286.932498:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310020352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587286.932549:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310020352:12345-0@lo:400:kworker.0 Request processed in 50us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587286.932566:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587286.932582:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587286.932587:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310020608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587286.932621:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310020608:12345-0@lo:400:kworker.0 Request processed in 34us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587286.932627:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587286.932666:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310020736 00000100:00100000:1.0:1788587286.932670:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310020736 00000100:00100000:1.0:1788587286.932692:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310020480 00000100:00100000:1.0:1788587286.932696:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310020480 00000100:00100000:1.0:1788587286.932709:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587286.932714:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310020736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587286.933019:0:16442:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587286.933030:0:16442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788587286.933105:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310020736:12345-0@lo:400:kworker.0 Request processed in 389us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587286.933112:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587286.933126:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587286.933133:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310020480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587286.933164:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310020480:12345-0@lo:400:kworker.0 Request processed in 32us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587286.933170:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587286.933208:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310020608:0@lo:400:kworker.0 00010000:00080000:1.0:1788587286.933221:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf35d57b80 x1875469310020480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587286.933231:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310020480:0@lo:400:kworker.0 00010000:00080000:1.0:1788587286.933263:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf35d56680 x1875469310020736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587286.933281:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310020736:0@lo:400:kworker.0 00000100:00100000:1.0:1788587286.933293:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310020352:0@lo:400:kworker.0 00000020:01000004:2.0:1788587286.935072:0:17772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788587286.935100:0:17772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8cbf062bcd40) 00000020:00000080:2.0:1788587286.935134:0:17772:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788587286.935258:0:17772:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf1095e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788587286.935263:0:17772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf1095e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788587286.935266:0:17772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf1095e800 3 00010000:00080000:2.0:1788587286.935319:0:17772:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf3b26e000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587286.946369:0:17772:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788587286.946658:0:17772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788587286.946732:0:17772:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587286.946749:0:17772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x419e1ae1f6344b94 00000100:00080000:1.0:1788587286.946764:0:17772:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587286.946772:0:17772:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8cbf3b26e000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587286.946896:0:17772:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d56300 x1875469310020864/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587286.946928:0:17772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788587286.946959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587286.946964:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587286.946968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587286.946971:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587286.946976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587286.946980:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587286.946984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587286.946989:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587286.946990:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469310020864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587286.947092:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587286.950138:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310020864 00000100:00100000:1.0:1788587286.950161:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310020864 00000100:00100000:1.0:1788587286.950234:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587286.950262:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469310020864:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788587286.950312:0:16444:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1788587286.950365:0:16444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x419e1ae1f6344b9b 00000004:00100000:1.0:1788587286.950390:0:16444:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587286.950501:0:16444:0:(import.c:65:import_set_state_nolock()) ffff8cbe05873000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587286.950621:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1875469310020864:12345-0@lo:38:llog_process_th.0 Request processed in 361us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587286.950629:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788587286.950705:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf35d56300 x1875469310020864/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587286.950719:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587286.950737:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788587286.950760:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587286.950768:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788587286.950771:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3b26e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587286.950779:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469310020864:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788587286.950921:0:17772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788587286.951107:0:17749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788587286.951161:0:17749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587286.951225:0:17749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587286.951238:0:17749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788587286.951299:0:17749:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788587286.951302:0:17749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587286.951304:0:17749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587286.951305:0:17749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587286.951307:0:17749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587286.951308:0:17749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587286.951310:0:17749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587286.951312:0:17749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587286.951313:0:17749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587286.951318:0:17749:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788587286.951321:0:17749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587286.951324:0:17749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587286.951325:0:17749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587286.951327:0:17749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587286.951328:0:17749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587286.951329:0:17749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587286.951331:0:17749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587286.951332:0:17749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587286.951334:0:17749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587286.951376:0:17749:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788587286.951396:0:17749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310020992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788587286.951479:0:17749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587286.951543:0:17749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587286.951690:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310020992 00000100:00100000:3.0:1788587286.951699:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310020992 00000100:00100000:3.0:1788587286.951771:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587286.951784:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:17749:x1875469310020992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587286.951874:0:16437:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788587286.951894:0:16437:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788587287.011347:0:16437:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788587287.011362:0:16437:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788587287.011472:0:16458:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587287.011478:0:16458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587287.011499:0:16458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.011517:0:16458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 21 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.011525:0:16458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 21 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.011533:0:16458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.011573:0:16458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 21 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.011588:0:16458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 21 pid: 16435 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587287.011602:0:16458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310021120:0@lo:104: 00000100:00100000:2.0:1788587287.011738:0:16458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587287.012322:0:16458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 21 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.012333:0:16458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 21 pid: 16436 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587287.012342:0:16458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310021248:0@lo:104: 00000100:00100000:2.0:1788587287.012385:0:16458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587287.015024:0:16458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf081ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587287.019159:0:16425:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788587287.019192:0:16425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310021120 00000100:00100000:0.0:1788587287.019204:0:16425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310021120 00000100:00100000:0.0:1788587287.019257:0:16425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310021248 00000100:00100000:0.0:1788587287.019262:0:16425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310021248 00000100:00100000:0.0:1788587287.019279:0:16425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587287.019288:0:16425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:16458:x1875469310021120:12345-0@lo:104: 00010000:00010000:0.0:1788587287.019305:0:16425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.019605:0:16425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587287.019626:0:16425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:16458:x1875469310021120:12345-0@lo:104: Request processed in 338us (7887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587287.019634:0:16425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587287.019654:0:16425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587287.019672:0:16425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:16458:x1875469310021248:12345-0@lo:104: 00010000:00010000:0.0:1788587287.019682:0:16425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.019784:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587287.019816:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.019825:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587287.019830:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.019839:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587287.019841:0:16458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310021120:0@lo:104: 10000000:00010000:3.0:1788587287.019850:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587287.019856:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587287.019893:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.019916:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587287.019936:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.019955:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26800/0x419e1ae1f6344af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344afa expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.019970:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587287.019973:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.019979:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587287.019982:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.019989:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587287.019995:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587287.020000:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587287.020014:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.020020:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587287.020035:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.020041:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344aec expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587287.020055:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587287.020062:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587287.020064:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587287.020080:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310021376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587287.020117:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587287.020163:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310021504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587287.020188:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587287.020645:0:16425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788587287.020654:0:16425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:16458:x1875469310021248:12345-0@lo:104: Request processed in 993us (8267us total) trans 0 rc 0/0 00010000:00010000:3.0:1788587287.020737:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587287.020761:0:16425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587287.021015:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310021376 00000100:00100000:0.0:1788587287.021021:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310021376 00010000:00010000:0.0:1788587287.021043:0:16428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 22 pid: 16435 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587287.021065:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310021504 00000100:00100000:0.0:1788587287.021068:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310021504 00010000:00010000:0.0:1788587287.021079:0:16428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 23 pid: 16436 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587287.021092:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587287.021099:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:3475:x1875469310021376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587287.021110:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587287.021115:0:16428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 23 pid: 16435 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021126:0:16428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 23 pid: 16435 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021152:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344af3 expref: 23 pid: 16435 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587287.021163:0:16426:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1788587287.021167:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587287.021218:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:3475:x1875469310021376:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587287.021225:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587287.021266:0:16458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310021248:0@lo:104: 00010000:00010000:2.0:1788587287.021286:0:16458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587287.021354:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310021376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587287.021490:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587287.021498:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe040be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:3472:x1875469310021504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587287.021575:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587287.021581:0:16428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 21 pid: 16436 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021591:0:16428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 21 pid: 16436 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021601:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26600/0x419e1ae1f6344aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344ae5 expref: 21 pid: 16436 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021616:0:16428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021623:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788587287.021637:0:16428:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010159995s 00010000:00010000:0.0:1788587287.021642:0:16428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021727:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021735:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021742:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021748:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aec00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587287.021752:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021760:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.021781:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.021875:0:16458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.021883:0:16458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587287.021889:0:16458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe062aec00/0x419e1ae1f6344ba2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587287.022011:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587287.022082:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe040be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:3472:x1875469310021504:12345-0@lo:103:ldlm_bl.0 Request processed in 585us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587287.022089:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587287.022228:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310021504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587287.032392:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:17749:x1875469310020992:12345-0@lo:253:mount.lustre.0 Request processed in 80602us (80904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587287.032407:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788587287.032535:0:17749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:17749:1875469310020992:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587287.032551:0:17749:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788587287.032555:0:17749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587287.032557:0:17749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587287.032558:0:17749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587287.032559:0:17749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587287.032560:0:17749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587287.032562:0:17749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587287.032563:0:17749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587287.032565:0:17749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587287.032566:0:17749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788587287.032581:0:17749:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788587287.033306:0:17749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587287.033493:0:17749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587287.033652:0:17749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587287.033985:0:17749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587287.034143:0:17749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587287.034416:0:17749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788587287.040626:0:17749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788587287.144355:0:17749:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788587287.144364:0:17749:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788587287.144398:0:17749:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788587287.144472:0:17749:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788587287.144486:0:17749:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788587287.144515:0:17749:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788587287.344028:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587287.470026:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788587288.301024:0:16439:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587288.301032:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe05dae000 from 9 10000000:01000000:3.0:1788587288.301037:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587288.301082:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587288.301095:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587288.301106:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587288.301131:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310021632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587288.301198:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587288.301242:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf11913f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587288.301361:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310021632 00000100:00100000:0.0:1788587288.301369:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310021632 00000100:00100000:0.0:1788587288.301465:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788587288.301476:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:16439:x1875469310021632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587288.301489:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587288.301503:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344ba9 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587288.301538:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 20 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587288.301549:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 20 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587288.301558:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27000, rc 0) 00000100:00100000:0.0:1788587288.301614:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:16439:x1875469310021632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587288.301621:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587288.301947:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310021632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587288.301964:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587288.301974:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587288.302030:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310021760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788587288.302071:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587288.304383:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587288.311018:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310021760 00000100:00100000:3.0:1788587288.311034:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310021760 00000100:00100000:3.0:1788587288.311096:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788587288.311107:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:16439:x1875469310021760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788587288.311134:0:16435:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788587288.311157:0:16435:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788587288.311161:0:16435:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788587288.311304:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:16439:x1875469310021760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 198us (9232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587288.311312:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587288.313745:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310021760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788587288.314124:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587288.314134:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587288.314146:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587288.314155:0:16439:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788587288.314158:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe04f8d000 from 9 10000000:01000000:1.0:1788587288.314161:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788587288.314193:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587288.314202:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587288.314211:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587288.314230:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310021888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587288.314286:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587288.314329:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587288.314403:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310021888 00000100:00100000:0.0:1788587288.314410:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310021888 00000100:00100000:0.0:1788587288.314468:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788587288.314477:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:16439:x1875469310021888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587288.314489:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587288.314503:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344bb7 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587288.314525:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 21 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587288.314537:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 21 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587288.314546:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26000, rc 0) 00000100:00100000:0.0:1788587288.314583:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310021888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587288.314600:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788587288.314830:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310021888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587288.314845:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587288.314854:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587288.314924:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310022016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788587288.314958:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587288.314975:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587288.314990:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310022016 00000100:00100000:1.0:1788587288.314994:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310022016 00000100:00100000:1.0:1788587288.315021:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788587288.315028:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310022016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788587288.315043:0:16436:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788587288.315059:0:16436:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788587288.315062:0:16436:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788587288.315137:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310022016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587288.315144:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788587288.315175:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310022016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788587288.315217:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587288.315224:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587288.315231:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587288.364388:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587289.008040:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587274/real 1788587274] req@ffff8cbe03d9df80 x1875469310009088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587289 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587289.008070:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe03d9df80 x1875469310009088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587289 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587289.008079:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587274/real 1788587274] req@ffff8cbe03d9f480 x1875469310009216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587289 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587289.008090:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe03d9f480 x1875469310009216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587289 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788587289.008109:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a386800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587289.008124:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788587289.008128:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310009088:0@lo:8:kworker.0 00000100:00080000:0.0:1788587289.008133:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587289.008138:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788587289.008141:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310009216:0@lo:8:kworker.0 00000100:00080000:0.0:1788587289.008231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587289.008234:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788587289.008237:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a386800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587289.008242:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1788587289.008246:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788587289.008252:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbf0a386800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587289.008272:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0586df80 x1875469310022272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587289.008299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587289.008302:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587289.008303:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587289.008307:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1788587289.008309:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788587289.008313:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10f58000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587289.008326:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0586dc00 x1875469310022400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587289.008359:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587289.008363:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587289.008366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587289.008369:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788587289.008409:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310022144:0@lo:400:kworker.0 00000100:00100000:0.0:1788587289.008478:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587289.008510:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469310022912:0@lo:400:kworker.0 00000100:00100000:0.0:1788587289.008537:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587289.008559:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587289.008565:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310022784:0@lo:400:kworker.0 00000100:00100000:0.0:1788587289.008587:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587289.008598:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310022144 00000100:00100000:3.0:1788587289.008606:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310022144 00000100:00100000:3.0:1788587289.008700:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587289.008705:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310022656:0@lo:400:kworker.0 00000100:00100000:3.0:1788587289.008713:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310022144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587289.008737:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587289.008757:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788587289.008764:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469310022528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587289.008773:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310022144:12345-0@lo:400:kworker.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587289.008784:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587289.008834:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310022656 00000100:00100000:1.0:1788587289.008839:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310022656 00000100:00100000:1.0:1788587289.008858:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587289.008865:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310022656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587289.008913:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310022656:12345-0@lo:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587289.008919:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587289.011325:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310022272:0@lo:8:kworker.0 00000100:00100000:1.0:1788587289.011399:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587289.011461:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310022400:0@lo:8:kworker.0 00000100:00100000:1.0:1788587289.011486:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587289.011531:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310022272 00000100:00100000:1.0:1788587289.011537:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310022272 00000100:00100000:1.0:1788587289.011562:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310022400 00000100:00100000:1.0:1788587289.011565:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310022400 00000100:00100000:1.0:1788587289.011577:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587289.011583:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310022272:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788587289.011611:0:17751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:1.0:1788587289.011639:0:17751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6344bc5 00002000:00100000:1.0:1788587289.011652:0:17751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cbe05876000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788587289.011656:0:17751:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788587289.011659:0:17751:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587289.012392:0:17751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788587289.012430:0:17751:0:(import.c:65:import_set_state_nolock()) ffff8cbe05870800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587289.012492:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469310022272:12345-0@lo:8:kworker.0 Request processed in 908us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587289.012511:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587289.012533:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587289.012538:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310022400:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788587289.012554:0:17751:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788587289.016481:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310022144:0@lo:400:kworker.0 00000100:00100000:3.0:1788587289.016758:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310022912 00000100:00100000:3.0:1788587289.016766:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310022912 00000100:00080000:0.0:1788587289.016975:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587289.017387:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310022784 00000100:00100000:3.0:1788587289.017392:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310022784 00000100:00100000:3.0:1788587289.017427:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587289.017437:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469310022912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587289.017511:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469310022912:12345-0@lo:400:kworker.0 Request processed in 76us (8972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587289.017519:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587289.017534:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587289.017553:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310022784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587289.017581:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310022784:12345-0@lo:400:kworker.0 Request processed in 30us (8993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587289.017587:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788587289.017732:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586ce00 x1875469310022784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587289.017755:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310022784:0@lo:400:kworker.0 00010000:00080000:0.0:1788587289.017768:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586fb80 x1875469310022912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587289.017776:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469310022912:0@lo:400:kworker.0 00000100:00100000:0.0:1788587289.018956:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587289.019005:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310023040:0@lo:400:kworker.0 00000100:00100000:0.0:1788587289.019054:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587289.019085:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310022656:0@lo:400:kworker.0 00000100:00100000:0.0:1788587289.019117:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310022528 00000100:00100000:0.0:1788587289.019123:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310022528 00000100:00100000:0.0:1788587289.019152:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310023040 00000100:00100000:0.0:1788587289.019155:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310023040 00000100:00100000:0.0:1788587289.019455:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587289.019466:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469310022528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587289.019517:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469310022528:12345-0@lo:400:kworker.0 Request processed in 53us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587289.019611:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587289.019623:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310023040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587289.019669:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310023040:12345-0@lo:400:kworker.0 Request processed in 50us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587289.019676:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587289.019773:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788587289.019864:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586df80 x1875469310022272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587289.019875:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587289.019883:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788587289.019891:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587289.019896:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788587289.019899:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a386800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788587289.019912:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587289.019917:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310022272:0@lo:8:kworker.0 00000004:00080000:2.0:1788587289.019964:0:16467:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788587289.019984:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16467:1875469310023296:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788587289.020014:0:16467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587289.020033:0:16467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf062aa600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587289.020042:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587289.020051:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310023168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587289.020072:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587289.020112:0:17750:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587289.020119:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1788587289.020475:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788587289.020502:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586f800 x1875469310022528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587289.020513:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469310022528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587289.020571:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310023168 00000100:00100000:3.0:1788587289.020578:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310023168 00010000:00080000:0.0:1788587289.020586:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586f100 x1875469310023040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587289.020597:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310023040:0@lo:400:kworker.0 00000100:00100000:3.0:1788587289.020614:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587289.020623:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469310023168:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788587289.020630:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788587289.020715:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587289.020778:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469310023168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587289.020819:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788587289.020823:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe03d9d500 x1875469310023168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587289.020839:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310023168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587289.022165:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310023296 00000100:00100000:2.0:1788587289.022172:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310023296 00000100:00100000:0.0:1788587289.022592:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587289.022602:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:16467:x1875469310023296:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788587289.035359:0:16466:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788587289.035788:0:16466:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 486784992848ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788587289.035951:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310022400:12345-0@lo:8:kworker.0 Request processed in 23406us (24459us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587289.035963:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788587289.036007:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587289.036013:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587289.036018:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310022400:0@lo:8:kworker.0 00002000:00080000:0.0:1788587289.037147:0:17877:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788587289.037157:0:17877:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788587289.037161:0:17877:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:2.0:1788587289.059753:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.059766:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.059784:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.059789:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.059822:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.059842:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.059853:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.059861:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.059905:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587289.060441:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.060449:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.060468:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.060471:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.060475:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.060485:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.060493:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.060500:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.060516:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788587289.061126:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.061132:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.061142:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.061145:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.061149:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.061159:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.061178:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.061185:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.061192:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788587289.065474:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788587289.065487:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.065501:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.065506:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.065518:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.065542:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.065550:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344bcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.065590:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587289.065595:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.065602:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.065606:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.065615:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.065626:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.066485:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344bd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.066507:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587289.066510:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.066516:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aea00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.066519:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.067729:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.067764:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.067772:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344bda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.067807:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.067810:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.067815:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.067836:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.072014:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.072029:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.072045:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.072049:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.072056:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.072070:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.072080:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.072087:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.072205:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587289.072529:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587289.072537:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.072547:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.072551:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.072562:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.072580:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.072597:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344be1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.072624:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.072626:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.072629:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.073001:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.073009:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073019:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.073022:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.073027:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073038:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073047:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073055:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073072:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587289.073660:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.073667:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073676:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.073686:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.073691:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073701:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073709:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073717:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.073771:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788587289.079397:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.079412:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.079439:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.079443:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.079449:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.079463:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.079473:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.079488:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.079500:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788587289.080157:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.080163:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.080172:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.080175:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.080179:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.080188:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.080196:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.080202:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.080211:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788587289.081562:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788587289.081574:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081587:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.081592:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081602:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081620:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081627:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7ac70ce/0x419e1ae1f6344be8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081652:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788587289.081656:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081669:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.081674:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081681:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081692:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081698:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000207e3207/0x419e1ae1f6344bef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081711:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587289.081715:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081721:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aec00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.081724:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081732:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081740:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081755:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad7ca842/0x419e1ae1f6344bf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081770:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587289.081774:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081781:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.081784:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081811:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081824:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081832:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007582fd04/0x419e1ae1f6344bfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.081848:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.081850:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.081854:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587289.082343:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587289.083940:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.085184:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.085194:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.085217:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.085220:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.085227:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.085373:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.085384:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.085393:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.085425:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587289.087847:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587289.087859:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.087878:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.087883:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.087894:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.087912:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.087920:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d99c839/0x419e1ae1f6344c04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.087938:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.087940:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.087941:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.088448:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.088457:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.088469:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.088473:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.088479:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.088491:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.088510:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.088517:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.088602:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587289.089177:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.089183:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.089193:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.089197:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.089201:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.089211:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.089220:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.089227:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.089452:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587289.089459:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.089467:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587289.089471:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.089480:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.089496:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.089503:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebe5a0c/0x419e1ae1f6344c0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.089519:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587289.089521:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587289.089945:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587289.090675:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587289.091643:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587289.091652:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.091663:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afe00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.091667:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.091677:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.091702:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.091710:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092f4865f/0x419e1ae1f6344c12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.091730:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.091732:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.091734:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.093463:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.093475:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.093491:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.093496:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.093502:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.093516:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.093534:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.093542:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.093563:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587289.094146:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.094153:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.094163:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.094172:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.094177:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.094186:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.094195:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.094202:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.094217:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788587289.094406:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587289.094414:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094430:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aee00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587289.094435:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094444:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094461:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094469:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4f6aff/0x419e1ae1f6344c19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094485:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587289.094489:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094496:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062aea00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587289.094499:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094507:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094524:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094540:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cebe5da7/0x419e1ae1f6344c20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.094554:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587289.094556:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587289.094558:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.095064:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.095071:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.095081:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.095084:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.095089:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.095099:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.095108:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.095121:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.095136:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587289.098046:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587289.098058:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.098072:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587289.098076:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.098087:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.098105:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.098112:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000400d2509/0x419e1ae1f6344c27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587289.098148:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587289.098150:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587289.098152:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.102991:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.103003:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.103021:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.103025:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.103031:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.103045:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.103055:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.103063:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.103085:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587289.103978:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.103987:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.104004:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.104008:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.104013:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.104023:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.104033:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.104040:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.104050:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788587289.104825:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587289.104833:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104843:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062af000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.104849:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104859:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104876:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104883:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba7095f4/0x419e1ae1f6344c2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104914:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587289.104917:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104923:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.104926:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104933:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104943:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104948:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.104958:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.104959:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.104961:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.107199:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.107209:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.107225:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.107230:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00000004:00080000:3.0:1788587289.107754:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788587289.107916:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587289.108728:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.108755:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.108778:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.108785:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.109354:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587289.109781:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587289.109790:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.109817:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00030200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587289.109829:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.109841:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.109859:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.109866:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7efc47e/0x419e1ae1f6344c3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587289.109886:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.109888:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.109890:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.110689:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.110699:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.110712:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.110716:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.110722:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.110734:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.110743:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.110750:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.110784:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587289.111213:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.111220:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.111230:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.111233:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587289.111353:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587289.111360:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.111368:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00030c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.111372:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.111382:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.111398:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.111426:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ccde78f/0x419e1ae1f6344c43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.111446:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587289.111448:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587289.111449:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587289.111549:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.111560:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.111568:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.111576:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.111592:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587289.112055:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.112062:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.112071:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.112080:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.112085:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.112096:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.112104:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.112111:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.112127:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587289.112392:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587289.112397:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112406:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.112410:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112428:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112440:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112446:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f76f9a2/0x419e1ae1f6344c4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112462:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587289.112465:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112477:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.112481:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112489:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112500:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112507:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382db905/0x419e1ae1f6344c51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.112520:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587289.112521:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587289.112523:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.112759:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.113103:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.113109:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.113120:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.113124:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.113128:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.113138:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.113146:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.113160:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.113176:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587289.113340:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587289.113345:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.113352:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.113355:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.113363:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.113384:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.113390:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e761f01/0x419e1ae1f6344c58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.113523:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587289.113526:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587289.113528:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587289.114138:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.114146:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114158:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.114161:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.114166:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114176:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114184:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114192:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114213:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587289.114628:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.114646:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114661:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.114664:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.114668:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114676:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114684:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114692:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.114711:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788587289.115148:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.115154:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115162:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.115166:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.115170:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115178:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115197:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115204:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115212:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788587289.115609:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.115615:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115625:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.115628:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.115631:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115639:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115646:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115652:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.115670:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788587289.116097:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.116103:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116112:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.116116:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.116120:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116128:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116136:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116142:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116150:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788587289.116554:0:17877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587289.116560:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116568:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788587289.116576:0:17877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587289.116581:0:17877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116590:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116598:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116605:0:17877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587289.116613:0:17877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00080000:2.0:1788587289.116823:0:17877:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1788587289.116919:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:16467:x1875469310023296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 94316us (96901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587289.116928:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587289.116980:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16467:1875469310023296:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788587289.116995:0:16467:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788587289.117034:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16467:1875469310023424:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788587289.117061:0:16467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587289.117084:0:16467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf348370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587289.117101:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310023424 00000100:00100000:2.0:1788587289.117106:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310023424 00000100:00100000:2.0:1788587289.117145:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587289.117153:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:16467:x1875469310023424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788587289.117192:0:17750:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1788587289.117572:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788587289.117580:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117589:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00031a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.117594:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117603:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117619:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117626:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075cfa7ef/0x419e1ae1f6344c5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117660:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788587289.117664:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117669:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.117672:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117681:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117691:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117698:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000680e0a2e/0x419e1ae1f6344c66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117710:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788587289.117713:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117719:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42045200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.117721:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117738:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117748:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117755:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6344c6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117775:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587289.117778:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117785:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.117789:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117826:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117836:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117843:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a26a8be8/0x419e1ae1f6344c74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117868:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587289.117871:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117878:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.117881:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117888:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117897:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117903:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc73221f/0x419e1ae1f6344c7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117914:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587289.117917:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117922:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42045800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587289.117925:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117942:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117952:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117960:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc331725/0x419e1ae1f6344c82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587289.117974:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587289.117976:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587289.117977:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587289.118372:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587289.127117:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:16467:x1875469310023424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9958us (10047us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788587289.127129:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587289.127469:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16467:1875469310023424:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788587289.127484:0:16467:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1788587289.389477:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587290.411076:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587290.667177:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587290.667200:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310023552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587290.667268:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587290.667736:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310023552 00000100:00100000:0.0:1788587290.667745:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310023552 00000100:00100000:0.0:1788587290.668131:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587290.668144:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310023552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587290.668200:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587290.668390:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310023552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 249us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587290.668398:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587290.669040:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587290.669063:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310023680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587290.669104:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587290.669136:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310023680 00000100:00100000:1.0:1788587290.669141:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310023680 00000100:00100000:1.0:1788587290.669179:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587290.669186:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310023680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587290.669209:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587290.669240:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310023680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587290.669247:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587290.669282:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310023680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587290.670086:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310023552:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587291.435000:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587292.308053:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788587292.308085:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788587292.459086:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788587292.784002:0:18119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788587293.484256:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587294.250950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587294.250957:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587294.250961:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587294.250968:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:0.0:1788587294.250974:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788587294.250980:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10f58000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587294.251001:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0586c380 x1875469310024192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587294.251046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587294.251050:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587294.251053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587294.251056:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788587294.251276:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310023808:0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.251344:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587294.251401:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310024448:0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.251425:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587294.251449:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788587294.251456:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310023936:0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.251479:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587294.251495:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310024576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.251516:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587294.251547:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310023808 00000100:00100000:1.0:1788587294.251553:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310023808 00000100:00100000:1.0:1788587294.251592:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788587294.251600:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:3474:x1875469310023808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.251644:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:3474:x1875469310023808:12345-0@lo:400:kworker.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587294.251651:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788587294.251679:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310024448 00000100:00100000:1.0:1788587294.251683:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310024448 00000100:00100000:1.0:1788587294.251697:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310023936 00000100:00100000:1.0:1788587294.251699:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310023936 00000100:00100000:1.0:1788587294.251711:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587294.251717:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310024448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.251751:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310024448:12345-0@lo:400:kworker.0 Request processed in 34us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587294.251757:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587294.251778:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587294.251783:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310023936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587294.251924:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310024064:0@lo:400:kworker.0 00000100:00100000:3.0:1788587294.251957:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587294.251974:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310024704:0@lo:400:kworker.0 00000100:00100000:3.0:1788587294.251996:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587294.252018:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788587294.252024:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310024320:0@lo:400:kworker.0 00000100:00100000:3.0:1788587294.252049:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587294.252068:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310024832:0@lo:400:kworker.0 00000100:00100000:3.0:1788587294.252097:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587294.252363:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587294.252372:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310024960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587294.252414:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587294.252645:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310024960 00000100:00100000:2.0:1788587294.252652:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310024960 00000100:00100000:2.0:1788587294.253395:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587294.253407:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310024960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587294.253439:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587294.253556:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310024960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587294.253564:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587294.253603:0:3475:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788587294.253623:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310024960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587294.253697:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310023936:12345-0@lo:400:kworker.0 Request processed in 1911us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587294.253706:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587294.253736:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310024576 00000100:00100000:1.0:1788587294.253741:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310024576 00000100:00100000:1.0:1788587294.253766:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310024704 00000100:00100000:1.0:1788587294.253769:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310024704 00000100:00100000:1.0:1788587294.253786:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310024320 00000100:00100000:1.0:1788587294.253788:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310024320 00000100:00100000:1.0:1788587294.253817:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310024832 00000100:00100000:1.0:1788587294.253821:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310024832 00000100:00100000:1.0:1788587294.253837:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587294.253857:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310024576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.253895:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310024576:12345-0@lo:400:kworker.0 Request processed in 39us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587294.253901:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587294.253913:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587294.253919:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310024704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.253957:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310024704:12345-0@lo:400:kworker.0 Request processed in 38us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587294.253962:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587294.253975:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587294.253981:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310024320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.254009:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310024320:12345-0@lo:400:kworker.0 Request processed in 29us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587294.254029:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587294.254044:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587294.254051:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310024832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.254087:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310024832:12345-0@lo:400:kworker.0 Request processed in 37us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587294.254093:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587294.254119:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310024064 00000100:00100000:1.0:1788587294.254123:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310024064 00000100:00100000:1.0:1788587294.254162:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587294.254169:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310024064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.254205:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310024064:12345-0@lo:400:kworker.0 Request processed in 37us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587294.254211:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788587294.254239:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586d180 x1875469310024320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587294.254250:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310024320:0@lo:400:kworker.0 00010000:00080000:1.0:1788587294.254265:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586f100 x1875469310024832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587294.254273:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310024832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.254283:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310024064:0@lo:400:kworker.0 00010000:00080000:1.0:1788587294.254296:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586d880 x1875469310024704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587294.254304:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310024704:0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.254346:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310023936:0@lo:400:kworker.0 00010000:00080000:1.0:1788587294.254359:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586c700 x1875469310024576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587294.254368:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310024576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.254392:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310023808:0@lo:400:kworker.0 00000100:00100000:1.0:1788587294.254406:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310024448:0@lo:400:kworker.0 00000100:00080000:0.0:1788587294.254751:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587294.254756:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587294.254759:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587294.254912:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310024192:0@lo:8:kworker.0 00000100:00100000:3.0:1788587294.254955:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587294.255047:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310024192 00000100:00100000:3.0:1788587294.255052:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310024192 00000100:00100000:3.0:1788587294.255074:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587294.255079:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3471:x1875469310024192:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788587294.255097:0:17877:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788587294.275281:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3471:x1875469310024192:12345-0@lo:8:kworker.0 Request processed in 20192us (20319us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587294.275293:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788587294.275341:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587294.275346:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788587294.275350:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310024192:0@lo:8:kworker.0 00010000:00010000:3.0:1788587294.507234:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587295.532175:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587295.788043:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310025088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587295.788120:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587295.788171:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310025088 00000100:00100000:0.0:1788587295.788180:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310025088 00000100:00100000:0.0:1788587295.788226:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587295.788236:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310025088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587295.788271:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587295.788537:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310025088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 301us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587295.788545:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587295.788561:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587295.788574:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310025216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587295.788606:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587295.788822:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310025216 00000100:00100000:0.0:1788587295.788826:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310025216 00000100:00100000:0.0:1788587295.788858:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587295.788971:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310025216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587295.788996:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587295.789038:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310025216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587295.789060:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587295.789098:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310025216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587295.792478:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310025088:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788587296.555947:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587296.940993:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788587297.583617:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587297.712942:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788587298.614671:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788587298.960129:0:18468:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587298.960133:0:18468:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788587298.960476:0:18468:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe0587a000 00000020:01000004:2.0:1788587298.960492:0:18468:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788587298.960508:0:18468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788587298.960524:0:18468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cbf053a99c0) 00000020:00000080:2.0:1788587298.960548:0:18468:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788587298.992320:0:18468:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788587298.993075:0:18468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788587298.995883:0:18468:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788587298.996100:0:18468:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788587298.996994:0:18468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788587298.998197:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 617: rc = 0 00100000:10000000:2.0:1788587298.998299:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 617: rc = 0 00100000:10000000:2.0:1788587298.998406:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 617: rc = 0 00100000:10000000:2.0:1788587298.999241:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788587299.000239:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788587299.000705:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788587299.001013:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1788587299.001276:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1788587299.001987:0:18468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:2.0:1788587299.004231:0:18468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788587299.004247:0:18468:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587299.004258:0:18468:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x419e1ae1f6344c90 00000020:01000004:2.0:1788587299.004266:0:18468:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788587299.004286:0:18468:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788587299.004289:0:18468:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788587299.004294:0:18468:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788587299.004317:0:18468:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788587299.004321:0:18468:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788587299.025421:0:18468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788587299.025558:0:18468:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.114@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788587299.025685:0:18468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788587299.025688:0:18468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587299.025690:0:18468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587299.025691:0:18468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587299.025693:0:18468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587299.025695:0:18468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587299.025696:0:18468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587299.025698:0:18468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587299.025699:0:18468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587299.025703:0:18468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788587299.025705:0:18468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587299.025712:0:18468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587299.025713:0:18468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587299.025714:0:18468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587299.025715:0:18468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587299.025716:0:18468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587299.025717:0:18468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587299.025718:0:18468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587299.025719:0:18468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587299.025745:0:18468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788587299.025765:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025344:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587299.025937:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587299.026047:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587299.026188:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310025344 00000100:00100000:0.0:1788587299.026197:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310025344 00000100:00100000:0.0:1788587299.026278:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788587299.026287:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:18468:x1875469310025344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587299.026316:0:16437:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788587299.026320:0:16437:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788587299.026323:0:16437:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788587299.034268:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:18468:x1875469310025344:12345-0@lo:253:mount.lustre.0 Request processed in 7974us (8322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.034282:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788587299.034387:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025344:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587299.034402:0:18468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788587299.034405:0:18468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587299.034406:0:18468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587299.034407:0:18468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587299.034408:0:18468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587299.034410:0:18468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587299.034411:0:18468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587299.034412:0:18468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587299.034414:0:18468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587299.034415:0:18468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788587299.034447:0:18468:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe0587a000 from lustre-OST0001 10000000:01000000:1.0:1788587299.034473:0:18468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788587299.034476:0:18468:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788587299.034485:0:18468:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf41a34d40 local copy 00010000:00010000:1.0:1788587299.034495:0:18468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587299.034732:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587299.034767:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587299.034860:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.034965:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310025472 00000100:00100000:2.0:1788587299.034971:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310025472 00000100:00100000:2.0:1788587299.035012:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788587299.035020:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:18468:x1875469310025472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587299.035184:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:18468:x1875469310025472:12345-0@lo:501:mount.lustre.0 Request processed in 164us (416us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587299.035199:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788587299.035521:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025472:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788587299.035540:0:18468:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788587299.035706:0:18468:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788587299.035714:0:18468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.035927:0:18468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587299.035952:0:18468:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe0587a000 10000000:01000000:3.0:1788587299.035957:0:18468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788587299.035962:0:18468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788587299.035965:0:18468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587299.035969:0:18468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788587299.035977:0:18468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788587299.036008:0:18468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.036017:0:18468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.036026:0:18468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587299.036042:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587299.036078:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.036113:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f14840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.036467:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310025600 00000100:00100000:2.0:1788587299.036474:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310025600 00000100:00100000:2.0:1788587299.036513:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788587299.036522:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:18468:x1875469310025600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587299.036533:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587299.036547:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f6344c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344c97 expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587299.036760:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f6344c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344c97 expref: 22 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587299.036773:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f6344c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344c97 expref: 22 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587299.036783:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044e00, rc 0) 00000100:00100000:2.0:1788587299.036855:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310025600:12345-0@lo:101:mount.lustre.0 Request processed in 333us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.036861:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788587299.037326:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587299.037343:0:18468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.037362:0:18468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587299.038146:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788587299.039211:0:18468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587299.039477:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788587299.039751:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788587299.039814:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788587299.039886:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788587299.039925:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788587299.039961:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788587299.040025:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788587299.040033:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788587299.040113:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587299.040172:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.040417:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587299.041436:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310025728 00000100:00100000:1.0:1788587299.041458:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310025728 00000100:00100000:1.0:1788587299.041617:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788587299.041628:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310025728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587299.042060:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310025728:12345-0@lo:501:mount.lustre.0 Request processed in 434us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587299.042069:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788587299.042164:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587299.042207:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587299.042252:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.042527:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f143c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.042657:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310025856 00000100:00100000:2.0:1788587299.042663:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310025856 00000100:00100000:2.0:1788587299.045009:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788587299.045027:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310025856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587299.045461:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310025856:12345-0@lo:503:mount.lustre.0 Request processed in 440us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.045470:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788587299.045621:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025856:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587299.046161:0:18468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587299.046232:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587299.046288:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.046334:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.046550:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310025984 00000100:00100000:2.0:1788587299.046562:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310025984 00000100:00100000:2.0:1788587299.046590:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788587299.046597:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310025984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587299.046836:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310025984:12345-0@lo:502:mount.lustre.0 Request processed in 238us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.046843:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788587299.047059:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310025984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587299.047279:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788587299.047328:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788587299.047389:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788587299.047439:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788587299.047476:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788587299.047508:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788587299.047585:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788587299.047624:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788587299.047666:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788587299.047697:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587299.048045:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.048072:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587299.048166:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310026112 00000100:00100000:1.0:1788587299.048173:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310026112 00000100:00100000:1.0:1788587299.048203:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788587299.048210:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310026112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587299.048379:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310026112:12345-0@lo:502:mount.lustre.0 Request processed in 168us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587299.048386:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788587299.048559:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587299.048638:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788587299.048648:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788587299.050495:0:18469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587299.050507:0:18469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788587299.050524:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587299.050527:0:18469:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788587299.050535:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587299.050552:0:18469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cbf181a0000) 00000020:00000080:1.0:1788587299.050579:0:18469:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788587299.050586:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788587299.050671:0:18469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe0587a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788587299.050680:0:18469:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788587299.050687:0:18469:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x419e1ae1f6344cac 00010000:00010000:1.0:1788587299.056587:0:18469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788587299.057037:0:18469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788587299.062204:0:18469:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788587299.069615:0:18469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788587299.069628:0:18469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587299.069639:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587299.069641:0:18469:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788587299.069645:0:18469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587299.069649:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587299.069650:0:18469:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587299.069654:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587299.069655:0:18469:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788587299.069658:0:18469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587299.069660:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587299.069661:0:18469:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788587299.069663:0:18469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587299.069665:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587299.069666:0:18469:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788587299.069669:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788587299.069729:0:18469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587299.069745:0:18469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587299.069746:0:18469:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788587299.069749:0:18469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788587299.070047:0:18468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788587299.070079:0:18468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788587299.070102:0:18468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.070115:0:18468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587299.070124:0:18468:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe0587a000 from 1 10000000:01000000:3.0:1788587299.070126:0:18468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587299.070162:0:18468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.070170:0:18468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.070180:0:18468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587299.070209:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587299.070274:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.070316:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587299.070392:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310026240 00000100:00100000:0.0:1788587299.070400:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310026240 00000100:00100000:0.0:1788587299.070447:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788587299.070455:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310026240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587299.070468:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587299.070480:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344cb3 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587299.070503:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 23 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587299.070523:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 23 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587299.070530:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27e00, rc 0) 00000100:00100000:0.0:1788587299.070569:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026240:12345-0@lo:101:mount.lustre.0 Request processed in 115us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.070575:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788587299.070712:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587299.070729:0:18468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.070750:0:18468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587299.071245:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788587299.072858:0:18468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587299.073139:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788587299.073183:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788587299.073245:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788587299.073253:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788587299.073337:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587299.073411:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.074862:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587299.078438:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310026368 00000100:00100000:0.0:1788587299.078452:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310026368 00000100:00100000:0.0:1788587299.078617:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788587299.078629:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587299.078963:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026368:12345-0@lo:501:mount.lustre.0 Request processed in 335us (5551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.078971:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788587299.079055:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587299.079103:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587299.079145:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.080625:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f143c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.080789:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310026496 00000100:00100000:2.0:1788587299.080816:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310026496 00000100:00100000:2.0:1788587299.080849:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788587299.080857:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587299.081076:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026496:12345-0@lo:503:mount.lustre.0 Request processed in 219us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.081084:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788587299.081185:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026496:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587299.081920:0:18468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587299.081995:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587299.082044:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.082066:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06051300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.082194:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310026624 00000100:00100000:2.0:1788587299.082199:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310026624 00000100:00100000:2.0:1788587299.082224:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788587299.082231:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587299.082855:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026624:12345-0@lo:502:mount.lustre.0 Request processed in 620us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.082864:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587299.083064:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587299.083325:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788587299.083601:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788587299.083658:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788587299.083694:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788587299.083727:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788587299.084176:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788587299.084217:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788587299.084252:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788587299.084299:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788587299.084336:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788587299.084424:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788587299.084465:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587299.084616:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587299.084702:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587299.084930:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310026752 00000100:00100000:0.0:1788587299.084938:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310026752 00000100:00100000:0.0:1788587299.085016:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788587299.085025:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587299.085235:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026752:12345-0@lo:502:mount.lustre.0 Request processed in 211us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.085243:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788587299.085324:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587299.085432:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788587299.085442:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788587299.086338:0:18473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587299.086348:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587299.086361:0:18473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788587299.086369:0:18473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe0587a000 00000020:00000080:3.0:1788587299.086372:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587299.086379:0:18473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587299.086381:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587299.086382:0:18473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788587299.086385:0:18473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587299.086387:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587299.086389:0:18473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788587299.086392:0:18473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe0587a000 00000020:00000080:3.0:1788587299.086394:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587299.086452:0:18473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587299.086456:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587299.086457:0:18473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788587299.086460:0:18473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587299.086463:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587299.086464:0:18473:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587299.086475:0:18473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe0587a000 00000020:00000080:3.0:1788587299.086477:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587299.086496:0:18473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587299.086499:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587299.086501:0:18473:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587299.086503:0:18473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587299.086506:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587299.086508:0:18473:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788587299.089631:0:18473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe0587a000 00000020:00000080:3.0:1788587299.089637:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587299.089752:0:18473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587299.089757:0:18473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587299.089759:0:18473:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788587299.089762:0:18473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788587299.092653:0:18468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788587299.092699:0:18468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587299.092726:0:18468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.092751:0:18468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587299.092821:0:18468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788587299.092824:0:18468:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe0587a000 10000000:01000000:3.0:1788587299.092827:0:18468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe0587a000 10000000:01000000:3.0:1788587299.092831:0:18468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587299.092836:0:18468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe0587a000 from 1 10000000:01000000:3.0:1788587299.092839:0:18468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587299.092874:0:18468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.092883:0:18468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.092902:0:18468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587299.092926:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587299.092989:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.093032:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf060513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587299.093186:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310026880 00000100:00100000:1.0:1788587299.093193:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310026880 00000100:00100000:1.0:1788587299.093243:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788587299.093252:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:18468:x1875469310026880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587299.093265:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587299.093277:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499fe00/0x419e1ae1f6344cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344cc1 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.093301:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499fe00/0x419e1ae1f6344cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344cc1 expref: 24 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.093312:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499fe00/0x419e1ae1f6344cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344cc1 expref: 24 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.093321:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fe00, rc 0) 00000100:00100000:1.0:1788587299.093373:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310026880:12345-0@lo:101:mount.lustre.0 Request processed in 122us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587299.093380:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788587299.093929:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310026880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587299.093945:0:18468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.093956:0:18468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587299.096944:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788587299.097334:0:18468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587299.102631:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788587299.102710:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788587299.102878:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788587299.102934:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788587299.102970:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788587299.103020:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788587299.103057:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788587299.103087:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788587299.103129:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788587299.103160:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788587299.103187:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788587299.103230:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788587299.103263:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788587299.103320:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788587299.103410:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788587299.103451:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788587299.103483:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788587299.103959:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788587299.104002:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788587299.104037:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788587299.104085:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788587299.104122:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788587299.104154:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788587299.104202:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788587299.104238:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788587299.104273:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788587299.104323:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788587299.106437:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788587299.106594:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788587299.106701:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788587299.107613:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788587299.107664:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788587299.107692:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788587299.108119:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788587299.108162:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788587299.108200:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788587299.108230:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788587299.108255:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788587299.108293:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788587299.108326:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788587299.108373:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788587299.108408:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788587299.108454:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788587299.108489:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788587299.110014:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788587299.110141:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788587299.110264:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788587299.110280:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788587299.110403:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587299.110466:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.111647:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf060513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.114576:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310027008 00000100:00100000:2.0:1788587299.114593:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310027008 00000100:00100000:2.0:1788587299.114652:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788587299.114662:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587299.115240:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027008:12345-0@lo:501:mount.lustre.0 Request processed in 578us (4771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.115251:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788587299.115996:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587299.116050:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587299.116108:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587299.116144:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310027136 00000100:00100000:2.0:1788587299.116150:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310027136 00000100:00100000:2.0:1788587299.116189:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788587299.116197:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587299.116361:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027136:12345-0@lo:503:mount.lustre.0 Request processed in 165us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.116947:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788587299.119539:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587299.119585:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587299.120448:0:18468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587299.120640:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587299.120720:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.120763:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf060516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587299.120846:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310027264 00000100:00100000:0.0:1788587299.120853:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310027264 00000100:00100000:0.0:1788587299.120906:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788587299.120919:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587299.121158:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027264:12345-0@lo:502:mount.lustre.0 Request processed in 241us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.121165:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788587299.121271:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587299.121712:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788587299.121762:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788587299.121959:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788587299.122012:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788587299.122047:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788587299.122094:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788587299.122132:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788587299.122164:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788587299.122211:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788587299.122246:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788587299.122278:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788587299.122344:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788587299.122604:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788587299.122647:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788587299.122744:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788587299.123033:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788587299.123079:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788587299.123143:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788587299.123204:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788587299.123246:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788587299.123326:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788587299.123461:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788587299.123606:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788587299.123712:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788587299.124055:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788587299.124111:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788587299.124170:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788587299.124237:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788587299.124277:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788587299.124326:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788587299.125465:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788587299.125711:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788587299.126047:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788587299.126125:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788587299.126162:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788587299.126207:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788587299.126239:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788587299.126266:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788587299.126303:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788587299.126335:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788587299.126983:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788587299.127032:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788587299.127091:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788587299.127150:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788587299.127187:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788587299.127237:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788587299.127273:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788587299.127306:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788587299.128486:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587299.128651:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.128846:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf060516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.130487:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310027392 00000100:00100000:2.0:1788587299.130501:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310027392 00000100:00100000:2.0:1788587299.130671:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788587299.130683:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587299.131219:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027392:12345-0@lo:502:mount.lustre.0 Request processed in 537us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.131237:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788587299.131326:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587299.131496:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788587299.131559:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788587299.131595:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587299.131640:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587299.132285:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310027520 00000100:00100000:1.0:1788587299.132293:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310027520 00000100:00100000:1.0:1788587299.132331:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788587299.132340:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587299.132535:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310027520:12345-0@lo:502:mount.lustre.0 Request processed in 196us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587299.132542:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788587299.132909:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf060516c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587299.132929:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310027520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587299.133071:0:18468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788587299.133086:0:18468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788587299.134443:0:18479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788587299.134472:0:18479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cbe052e8000) 00000020:00000080:1.0:1788587299.134498:0:18479:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788587299.134643:0:18479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe0587a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587299.134648:0:18479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe0587a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587299.134652:0:18479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe0587a000 3 00010000:00080000:1.0:1788587299.134682:0:18479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe05877800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587299.138101:0:18479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788587299.138643:0:18479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788587299.138683:0:18479:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587299.138695:0:18479:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x419e1ae1f6344cd6 00000100:00080000:1.0:1788587299.138707:0:18479:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587299.138713:0:18479:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbe05877800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587299.139170:0:18479:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d56300 x1875469310027648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587299.139202:0:18479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788587299.139259:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310027648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587299.139330:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587299.139433:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587299.139437:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587299.139440:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587299.139444:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:2.0:1788587299.139446:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788587299.139450:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10f58000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587299.139462:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe05c1a680 x1875469310028032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587299.139482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587299.139486:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587299.139489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587299.139492:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587299.140290:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310027648 00000100:00100000:2.0:1788587299.140299:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310027648 00000100:00100000:2.0:1788587299.140337:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587299.140344:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3471:x1875469310027648:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788587299.140388:0:17774:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000100:00100000:0.0:1788587299.140398:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310027776:0@lo:400:kworker.0 00000020:00000080:2.0:1788587299.140436:0:17774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x419e1ae1f6344cdd 00000004:00100000:2.0:1788587299.140454:0:17774:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788587299.140485:0:17774:0:(import.c:65:import_set_state_nolock()) ffff8cbe0587e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587299.140547:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587299.140568:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1875469310027648:12345-0@lo:38:llog_process_th.0 Request processed in 221us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.140576:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587299.140585:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310028416:0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.140603:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310028288:0@lo:400:kworker.0 00000100:00100000:0.0:1788587299.140619:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587299.140639:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587299.140674:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310027776 00000100:00100000:2.0:1788587299.140683:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310027904:0@lo:400:kworker.0 00000100:00100000:0.0:1788587299.140689:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310027776 00000100:00100000:2.0:1788587299.140718:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587299.140725:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310028288 00000100:00100000:0.0:1788587299.140729:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310028288 00000100:00100000:2.0:1788587299.140741:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310028544:0@lo:400:kworker.0 00000100:00100000:0.0:1788587299.140747:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587299.140757:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310027776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.140767:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587299.140820:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310027776:12345-0@lo:400:kworker.0 Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.140826:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587299.140839:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587299.140845:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310028288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587299.140876:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310028288:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.140882:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587299.140897:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310028416 00000100:00100000:0.0:1788587299.140900:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310028416 00000100:00100000:0.0:1788587299.140922:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310028544 00000100:00100000:0.0:1788587299.140924:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310028544 00000100:00100000:0.0:1788587299.140944:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587299.140949:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310028416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587299.140978:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310028416:12345-0@lo:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.140985:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587299.140992:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788587299.140998:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587299.141005:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310028160:0@lo:400:kworker.0 00000100:00100000:0.0:1788587299.141009:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310028544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.141046:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587299.141054:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310028544:12345-0@lo:400:kworker.0 Request processed in 48us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.141061:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587299.141064:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310028672:0@lo:400:kworker.0 00000100:00100000:0.0:1788587299.141084:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310028160 00000100:00100000:0.0:1788587299.141088:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310028160 00000100:00100000:2.0:1788587299.141093:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587299.141110:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310028672 00000100:00100000:0.0:1788587299.141114:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310028672 00010000:00080000:2.0:1788587299.141124:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05c19f80 x1875469310028544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587299.141133:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587299.141140:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310028160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.141142:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310028544:0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.141179:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310028032:0@lo:8:kworker.0 00000100:00100000:0.0:1788587299.141207:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310028160:12345-0@lo:400:kworker.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.141213:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587299.141221:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587299.141238:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587299.141246:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310028672:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788587299.141251:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf35d56300 x1875469310027648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587299.141262:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587299.141269:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788587299.141277:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:0.0:1788587299.141282:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310028672:12345-0@lo:400:kworker.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00080000:2.0:1788587299.141292:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:0.0:1788587299.141293:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788587299.141296:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587299.141306:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310027648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587299.141326:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310028288:0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.141346:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310027904 00000100:00100000:2.0:1788587299.141364:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310027904 00000100:00080000:0.0:1788587299.141368:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587299.141375:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587299.141377:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587299.141399:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310028032 00010000:00080000:0.0:1788587299.141400:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05c1b100 x1875469310028160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587299.141404:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310028032 00000100:00100000:0.0:1788587299.141414:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310028160:0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.141429:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788587299.141431:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05c18380 x1875469310028672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587299.141441:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310027904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.141479:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310027904:12345-0@lo:400:kworker.0 Request processed in 42us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.141485:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587299.141497:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587299.141501:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310028032:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788587299.141546:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310028672:0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.141554:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310028032:12345-0@lo:8:kworker.0 Request processed in 49us (342us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788587299.141563:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587299.141566:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310027904:0@lo:400:kworker.0 00000100:00100000:2.0:1788587299.141601:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587299.141607:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587299.141612:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788587299.141617:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310028032:0@lo:8:kworker.0 00000100:00100000:0.0:1788587299.141626:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310027776:0@lo:400:kworker.0 00010000:00080000:0.0:1788587299.141640:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe05c18a80 x1875469310028416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587299.141648:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310028416:0@lo:400:kworker.0 00000020:01000004:0.0:1788587299.148365:0:18479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788587299.148383:0:18479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8cbe037acd40) 00000020:00000080:0.0:1788587299.148410:0:18479:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788587299.148489:0:18479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe0587a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788587299.148493:0:18479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe0587a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788587299.148495:0:18479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe0587a000 3 00010000:00080000:0.0:1788587299.148614:0:18479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe053cb000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.114@tcp at head 00010000:00010000:0.0:1788587299.151378:0:18479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788587299.151641:0:18479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788587299.151683:0:18479:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788587299.151695:0:18479:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x419e1ae1f6344ceb 00000100:00080000:0.0:1788587299.151705:0:18479:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587299.151710:0:18479:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cbe053cb000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587299.151746:0:18479:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe0586e300 x1875469310028800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587299.151775:0:18479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788587299.152085:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469310028800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587299.152157:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587299.152449:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310028800 00000100:00100000:0.0:1788587299.152456:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310028800 00000100:00100000:0.0:1788587299.152493:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587299.152501:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310028800:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788587299.152537:0:16442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1788587299.152573:0:16442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x419e1ae1f6344cf2 00000004:00100000:0.0:1788587299.152594:0:16442:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587299.152625:0:16442:0:(import.c:65:import_set_state_nolock()) ffff8cbe053cd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587299.152677:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1875469310028800:12345-0@lo:38:llog_process_th.0 Request processed in 175us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587299.152685:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788587299.152855:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe0586e300 x1875469310028800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587299.152867:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587299.153002:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788587299.153010:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587299.153015:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788587299.153018:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe053cb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587299.153024:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469310028800:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788587299.154282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587299.154289:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587299.154292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587299.154295:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788587299.161652:0:18479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788587299.161762:0:18468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788587299.161819:0:18468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587299.161835:0:18468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.161847:0:18468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788587299.162001:0:18468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587299.162003:0:18468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587299.162005:0:18468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587299.162006:0:18468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587299.162007:0:18468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587299.162009:0:18468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587299.162010:0:18468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587299.162012:0:18468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587299.162013:0:18468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587299.162017:0:18468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788587299.162019:0:18468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587299.162025:0:18468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587299.162026:0:18468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587299.162027:0:18468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587299.162028:0:18468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587299.162029:0:18468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587299.162030:0:18468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587299.162031:0:18468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587299.162032:0:18468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587299.162056:0:18468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788587299.162074:0:18468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310028928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587299.162137:0:18468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.162172:0:18468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06051cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587299.162468:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310028928 00000100:00100000:1.0:1788587299.162475:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310028928 00000100:00100000:1.0:1788587299.163020:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788587299.163032:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:18468:x1875469310028928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788587299.163064:0:16436:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788587299.163078:0:16436:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788587299.206485:0:16436:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788587299.206498:0:16436:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788587299.206501:0:16458:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788587299.206506:0:16458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788587299.206527:0:16458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.206547:0:16458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 24 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.206555:0:16458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 24 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.206572:0:16458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.206612:0:16458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 24 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.206624:0:16458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 24 pid: 16435 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587299.206637:0:16458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310029056:0@lo:104: 00000100:00100000:1.0:1788587299.206697:0:16458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587299.206756:0:16458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 24 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.206764:0:16458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 24 pid: 16436 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587299.206773:0:16458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310029184:0@lo:104: 00000100:00100000:1.0:1788587299.206809:0:16458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587299.206841:0:16458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3ccd7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587299.206856:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310029056 00000100:00100000:1.0:1788587299.206856:0:16425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310029184 00000100:00100000:2.0:1788587299.206862:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310029056 00000100:00100000:1.0:1788587299.206862:0:16425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310029184 00000100:00100000:2.0:1788587299.206898:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587299.206906:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:16458:x1875469310029056:12345-0@lo:104: 00010000:00010000:2.0:1788587299.206918:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587299.207163:0:16458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310029056:0@lo:104: 00010000:00010000:2.0:1788587299.207168:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587299.207201:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:16458:x1875469310029056:12345-0@lo:104: Request processed in 270us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.207224:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587299.207264:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587299.207271:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:16458:x1875469310029184:12345-0@lo:104: 00010000:00010000:2.0:1788587299.207280:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587299.207510:0:16458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16458:1875469310029184:0@lo:104: 00010000:00010000:1.0:1788587299.207531:0:16458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207670:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587299.207678:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207685:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587299.207690:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207698:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587299.207704:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587299.207709:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587299.207742:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207749:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587299.207768:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207788:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e000/0x419e1ae1f6344bb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344bbe expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207831:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587299.207835:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207840:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3600 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587299.207843:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207850:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587299.207856:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587299.207862:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587299.207877:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207884:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587299.207891:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207897:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3600/0x419e1ae1f6344ba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344bb0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.207909:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587299.207916:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587299.207918:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587299.207930:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310029312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587299.207963:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587299.207992:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587299.207998:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310029440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587299.208095:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788587299.208102:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:16458:x1875469310029184:12345-0@lo:104: Request processed in 831us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.208110:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788587299.208204:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587299.208397:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587299.208521:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310029312 00000100:00100000:2.0:1788587299.208527:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310029312 00010000:00010000:2.0:1788587299.208552:0:16429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 25 pid: 16435 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587299.208577:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310029440 00000100:00100000:2.0:1788587299.208580:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310029440 00010000:00010000:2.0:1788587299.208591:0:16429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 26 pid: 16436 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587299.208600:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587299.208609:0:16429:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788587299.208609:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+26:3472:x1875469310029312:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587299.208616:0:16429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788587299.208622:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587299.208627:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 26 pid: 16435 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208639:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 26 pid: 16435 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208654:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344bb7 expref: 26 pid: 16435 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208668:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587299.208703:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+25:3472:x1875469310029312:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587299.208710:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587299.208723:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587299.208724:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310029312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587299.208729:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3472:x1875469310029440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587299.208735:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587299.208740:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 24 pid: 16436 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208748:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 24 pid: 16436 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208759:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344ba9 expref: 24 pid: 16436 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208769:0:16427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208777:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788587299.208789:0:16427:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010159995s 00010000:00010000:1.0:1788587299.208927:0:16427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208936:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208943:0:16427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208961:0:16427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208967:0:16427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587299.208971:0:16427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208984:0:16427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.208995:0:16427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587299.209060:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587299.209100:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:3472:x1875469310029440:12345-0@lo:103:ldlm_bl.0 Request processed in 370us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587299.209107:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587299.209251:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310029440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587299.209861:0:16458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.209871:0:16458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587299.209878:0:16458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6344cf9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587299.216357:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:18468:x1875469310028928:12345-0@lo:253:mount.lustre.0 Request processed in 53303us (54194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587299.216372:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788587299.216542:0:18468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:18468:1875469310028928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788587299.216672:0:18468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788587299.216677:0:18468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587299.216679:0:18468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587299.216680:0:18468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587299.216681:0:18468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587299.216682:0:18468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587299.216684:0:18468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587299.216685:0:18468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587299.216686:0:18468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587299.216688:0:18468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788587299.216703:0:18468:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788587299.224056:0:18468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587299.224285:0:18468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587299.224478:0:18468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587299.224581:0:18468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587299.224746:0:18468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587299.225019:0:18468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788587299.225695:0:18468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788587299.285941:0:18468:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788587299.285951:0:18468:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788587299.285985:0:18468:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587299.286044:0:18468:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587299.286060:0:18468:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788587299.286088:0:18468:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1788587299.372096:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587299.372117:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310029568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587299.372340:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587299.372433:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310029568 00000100:00100000:1.0:1788587299.372440:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310029568 00000100:00100000:1.0:1788587299.372492:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587299.372503:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310029568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587299.372539:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587299.372595:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310029568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587299.372602:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587299.372911:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310029568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788587299.627000:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587300.202870:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587285/real 1788587285] req@ffff8cbe03d9e300 x1875469310017664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587300 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587300.202900:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe03d9e300 x1875469310017664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587300 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587300.202910:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587285/real 1788587285] req@ffff8cbe03d9c000 x1875469310017792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587300 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587300.202922:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe03d9c000 x1875469310017792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587300 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587300.202939:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbe000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587300.202959:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587300.202964:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310017664:0@lo:8:kworker.0 00000100:00080000:2.0:1788587300.202970:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e18800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587300.202974:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587300.202977:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310017792:0@lo:8:kworker.0 00000100:00080000:1.0:1788587300.204727:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587300.204734:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788587300.204745:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587300.204757:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10f58000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587300.204782:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03da0700 x1875469310029952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587300.204835:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587300.204838:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788587300.204840:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbe000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587300.204843:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 483 00000100:00080000:1.0:1788587300.204848:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587300.204852:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cbf3abbe000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587300.204863:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03da0e00 x1875469310030336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587300.204871:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587300.204873:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788587300.204875:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e18800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587300.204878:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 483 00000100:00080000:1.0:1788587300.204880:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587300.204883:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cbe03e18800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587300.204892:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03da1f80 x1875469310030464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587300.204951:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310029824:0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205103:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.205138:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310030720:0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205163:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.205197:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788587300.205202:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310030080:0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205225:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.205243:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310030848:0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205262:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.205294:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310029824 00000100:00100000:1.0:1788587300.205301:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310029824 00000100:00100000:1.0:1788587300.205354:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587300.205363:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310029824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205414:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310029824:12345-0@lo:400:kworker.0 Request processed in 51us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.205421:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587300.205444:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310030720 00000100:00100000:1.0:1788587300.205448:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310030720 00000100:00100000:1.0:1788587300.205470:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310030080 00000100:00100000:1.0:1788587300.205473:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310030080 00000100:00100000:1.0:1788587300.205482:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310030848 00000100:00100000:1.0:1788587300.205484:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310030848 00000100:00100000:1.0:1788587300.205495:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587300.205501:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310030720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205530:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310030720:12345-0@lo:400:kworker.0 Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.205536:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587300.205547:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587300.205552:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310030080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205578:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310030080:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.205584:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587300.205606:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587300.205612:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310030848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205641:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310030848:12345-0@lo:400:kworker.0 Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.205646:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788587300.205683:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da3480 x1875469310030080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587300.205694:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310030080:0@lo:400:kworker.0 00010000:00080000:1.0:1788587300.205703:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da2d80 x1875469310030848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587300.205711:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310030848:0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205719:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310029824:0@lo:400:kworker.0 00010000:00080000:1.0:1788587300.205728:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da0000 x1875469310030720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587300.205735:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310030720:0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.205767:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310029952:0@lo:8:kworker.0 00000100:00100000:1.0:1788587300.205813:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.205833:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310030336:0@lo:8:kworker.0 00000100:00100000:1.0:1788587300.205853:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.205878:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310030464:0@lo:8:kworker.0 00000100:00100000:1.0:1788587300.205897:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.205923:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310029952 00000100:00100000:1.0:1788587300.205927:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310029952 00000100:00100000:1.0:1788587300.205952:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310030336 00000100:00100000:1.0:1788587300.205955:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310030336 00000100:00100000:1.0:1788587300.205977:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310030464 00000100:00100000:1.0:1788587300.205979:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310030464 00000100:00100000:1.0:1788587300.205988:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587300.205993:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310029952:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788587300.206019:0:17751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1788587300.206045:0:17751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6344d00 00002000:00100000:1.0:1788587300.206058:0:17751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cbe03629800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788587300.206062:0:17751:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788587300.206064:0:17751:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587300.206391:0:17751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788587300.206413:0:17751:0:(import.c:65:import_set_state_nolock()) ffff8cbe0362b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587300.206455:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469310029952:12345-0@lo:8:kworker.0 Request processed in 460us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.206462:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587300.206476:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587300.206480:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310030336:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788587300.206495:0:17751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1788587300.206512:0:17751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6344d07 00002000:00100000:1.0:1788587300.206518:0:17751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8cbe03628000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788587300.206521:0:17751:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788587300.206523:0:17751:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587300.206652:0:17751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788587300.206665:0:17751:0:(import.c:65:import_set_state_nolock()) ffff8cbe0362c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587300.206695:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469310030336:12345-0@lo:8:kworker.0 Request processed in 213us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.206710:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587300.206724:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587300.206728:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310030464:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788587300.206742:0:17751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1788587300.206760:0:17751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6344d0e 00002000:00100000:1.0:1788587300.206766:0:17751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8cbe0362c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788587300.206769:0:17751:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788587300.206771:0:17751:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587300.206834:0:17751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788587300.206846:0:17751:0:(import.c:65:import_set_state_nolock()) ffff8cbe03629000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587300.206877:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469310030464:12345-0@lo:8:kworker.0 Request processed in 148us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.206883:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788587300.206926:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da0700 x1875469310029952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587300.206939:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788587300.206945:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788587300.206949:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788587300.206952:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788587300.206972:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788587300.206977:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310029952:0@lo:8:kworker.0 00000004:00080000:0.0:1788587300.206984:0:16468:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788587300.206989:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587300.206993:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788587300.206998:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788587300.207001:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788587300.207008:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbe000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788587300.207019:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788587300.207022:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310030336:0@lo:8:kworker.0 00010000:00080000:1.0:1788587300.207035:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da1f80 x1875469310030464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587300.207042:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587300.207045:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788587300.207049:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788587300.207052:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788587300.207055:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e18800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788587300.207065:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788587300.207067:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310030464:0@lo:8:kworker.0 00000004:00080000:1.0:1788587300.207116:0:17084:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788587300.207133:0:17084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17084:1875469310031360:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788587300.207150:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310029696:0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.207161:0:17084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.207181:0:17084:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f01540 going to sleep for 11 seconds 00000004:00080000:1.0:1788587300.207196:0:17083:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788587300.207199:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.207232:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310030592:0@lo:400:kworker.0 00000100:00100000:2.0:1788587300.207258:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.207278:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310031104:0@lo:400:kworker.0 00000100:00100000:2.0:1788587300.207300:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.207322:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788587300.207328:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310030208:0@lo:400:kworker.0 00000100:00100000:2.0:1788587300.207375:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.207397:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310030976:0@lo:400:kworker.0 00000100:00100000:2.0:1788587300.207417:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788587300.207453:0:17087:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788587300.207469:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17087:1875469310031616:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788587300.207498:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.207518:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587300.207537:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310029696 00000100:00100000:2.0:1788587300.207542:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310029696 00000004:00080000:1.0:1788587300.207564:0:17083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 497956768793ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788587300.207579:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788587300.207591:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310031232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587300.207592:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:3475:x1875469310029696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.207630:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.207647:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:3475:x1875469310029696:12345-0@lo:400:kworker.0 Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587300.207655:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788587300.207657:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587300.207665:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310031488:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788587300.207676:0:16468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 497956880338ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788587300.207692:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.207693:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310030592 00000004:00080000:0.0:1788587300.207697:0:17086:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788587300.207698:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310030592 00000100:00100000:2.0:1788587300.207733:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310031104 00000100:00100000:2.0:1788587300.207737:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310031104 00000100:00100000:1.0:1788587300.207751:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310031232 00000100:00100000:1.0:1788587300.207756:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310031232 00000100:00100000:2.0:1788587300.207768:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310030976 00000100:00100000:2.0:1788587300.207772:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310030976 00000100:00100000:1.0:1788587300.207783:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310031488 00000100:00100000:1.0:1788587300.207816:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310031488 00000100:00100000:2.0:1788587300.207834:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587300.207841:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587300.207845:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310030592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.207852:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3472:x1875469310031232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587300.207868:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587300.207884:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310030592:12345-0@lo:400:kworker.0 Request processed in 43us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587300.207893:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587300.207909:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587300.207913:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3472:x1875469310031232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587300.207921:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469310031104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587300.207923:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587300.207940:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587300.207949:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3472:x1875469310031488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587300.207960:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587300.207970:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469310031104:12345-0@lo:400:kworker.0 Request processed in 50us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587300.207978:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:0.0:1788587300.207985:0:17086:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 497957189756ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788587300.207992:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3472:x1875469310031488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.207998:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587300.208062:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587300.208069:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310030976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587300.208099:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310030976:12345-0@lo:400:kworker.0 Request processed in 31us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587300.208105:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587300.208212:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310030208 00000100:00100000:2.0:1788587300.208217:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310030208 00000100:00100000:2.0:1788587300.208245:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587300.208253:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310030208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587300.208289:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310030208:12345-0@lo:400:kworker.0 Request processed in 38us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587300.208296:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788587300.208319:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587300.208323:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587300.208329:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587300.208332:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587300.208365:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310030208:0@lo:400:kworker.0 00010000:00080000:2.0:1788587300.208378:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da0380 x1875469310030976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587300.208387:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310030976:0@lo:400:kworker.0 00000100:00100000:2.0:1788587300.208395:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310029696:0@lo:400:kworker.0 00010000:00080000:2.0:1788587300.208405:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da3800 x1875469310030592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587300.208572:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310030592:0@lo:400:kworker.0 00010000:00080000:2.0:1788587300.208585:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da2300 x1875469310031104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587300.208592:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310031104:0@lo:400:kworker.0 00000004:00080000:3.0:1788587300.209440:0:16469:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788587300.209470:0:16469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16469:1875469310031872:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788587300.209510:0:16469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587300.209533:0:16469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf032fd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587300.209936:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587300.209955:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310031744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587300.210084:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587300.212222:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310031744 00000100:00100000:3.0:1788587300.212235:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310031744 00000100:00080000:2.0:1788587300.212273:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587300.212297:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587300.212307:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469310031744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587300.212330:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587300.212418:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3475:x1875469310031744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587300.212425:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587300.212452:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310031360 00000100:00100000:3.0:1788587300.212456:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310031360 00000100:00100000:3.0:1788587300.212476:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310031616 00000100:00100000:3.0:1788587300.212479:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310031616 00000100:00100000:3.0:1788587300.212490:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310031872 00000100:00100000:3.0:1788587300.212493:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310031872 00000100:00100000:3.0:1788587300.212504:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587300.212509:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17084:x1875469310031360:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:2.0:1788587300.213642:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34a52300 x1875469310031744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587300.213666:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310031744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587300.215975:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587300.215993:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17087:x1875469310031616:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:0.0:1788587300.221031:0:17750:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788587300.221041:0:17750:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788587300.221141:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17087:x1875469310031616:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5150us (13638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587300.221151:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788587300.221365:0:17087:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05c1a300 x1875469310031616/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587300.221382:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17087:1875469310031616:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788587300.221397:0:17087:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788587300.221440:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17087:1875469310032000:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788587300.221474:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587300.221488:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633780 going to sleep for 11 seconds 00010000:00080000:0.0:1788587300.221540:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe05c19c00 x1875469310031488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587300.221563:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310031488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587300.221584:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310031232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587300.221616:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310032000 00000100:00100000:0.0:1788587300.221622:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310032000 00002000:00080000:3.0:1788587300.221786:0:17753:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788587300.221791:0:17753:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788587300.221861:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17084:x1875469310031360:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9350us (14698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587300.221869:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587300.221888:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587300.221898:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:16469:x1875469310031872:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788587300.225412:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587300.225425:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17087:x1875469310032000:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788587300.225458:0:17750:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788587300.225527:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17087:x1875469310032000:12345-0@lo:5:osp-pre-1-1.0 Request processed in 104us (4052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587300.225534:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587300.225669:0:17084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17084:1875469310031360:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788587300.225683:0:17084:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788587300.225725:0:17084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17084:1875469310032128:0@lo:5:osp-pre-0-1.0 00010000:00080000:0.0:1788587300.225752:0:17087:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0586f800 x1875469310032000/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587300.225766:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17087:1875469310032000:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788587300.225776:0:17087:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788587300.225783:0:17084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.225831:0:17084:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f01540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587300.225864:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310032128 00000100:00100000:1.0:1788587300.226019:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310032128 00000100:00100000:1.0:1788587300.226048:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587300.226054:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17084:x1875469310032128:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788587300.226072:0:17877:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788587300.226106:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17084:x1875469310032128:12345-0@lo:5:osp-pre-0-1.0 Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.226114:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587300.226152:0:17084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17084:1875469310032128:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788587300.226161:0:17084:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788587300.226185:0:17084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17084:1875469310032256:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788587300.226209:0:17084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.226227:0:17084:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f01540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587300.226239:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310032256 00000100:00100000:1.0:1788587300.226243:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310032256 00000100:00100000:1.0:1788587300.226263:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587300.226268:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17084:x1875469310032256:12345-0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788587300.226830:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17087:1875469310032384:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788587300.226861:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587300.226874:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587300.226887:0:17750:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788587300.226894:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788587300.227005:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310032384 00000100:00100000:0.0:1788587300.227010:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310032384 00002000:00080000:1.0:1788587300.227031:0:17877:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788587300.227103:0:18542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587300.227113:0:18542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17087:x1875469310032384:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788587300.227140:0:18542:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:3.0:1788587300.237895:0:17753:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788587300.237906:0:17753:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788587300.237917:0:17753:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:3.0:1788587300.255687:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587300.255698:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255715:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1788587300.255720:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587300.255727:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255745:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255756:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255764:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255785:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587300.255822:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.255829:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255836:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.255841:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255860:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255876:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255883:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.255900:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.255903:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.255905:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788587300.280832:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587300.280844:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.280860:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1788587300.280865:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587300.280872:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.280886:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.280896:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.280911:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.280930:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587300.280944:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.280950:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.280959:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.280964:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.280974:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.280992:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.281001:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c47fa1d6/0x419e1ae1f6344d1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.281023:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.281025:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.281028:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587300.281211:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:17084:x1875469310032256:12345-0@lo:5:osp-pre-0-1.0 Request processed in 54937us (54995us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788587300.281221:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587300.281280:0:17084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17084:1875469310032256:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788587300.281296:0:17084:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788587300.281358:0:17084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17084:1875469310032512:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788587300.281394:0:17084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.283861:0:17084:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587300.284907:0:16454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310032512 00000100:00100000:3.0:1788587300.284925:0:16454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310032512 00000100:00100000:3.0:1788587300.284975:0:16454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587300.284984:0:16454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17084:x1875469310032512:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788587300.286549:0:16454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17084:x1875469310032512:12345-0@lo:900:osp-pre-0-1.0 Request processed in 1560us (5148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587300.286562:0:16454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587300.286621:0:17084:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da1f80 x1875469310032512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587316 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587300.286636:0:17084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17084:1875469310032512:0@lo:900:osp-pre-0-1.0 00002000:00010000:3.0:1788587300.293124:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587300.293136:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293153:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1788587300.293158:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587300.293164:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293178:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293188:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293196:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293241:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587300.293377:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587300.293385:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.293394:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587300.293400:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.293423:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.293446:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.293454:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001861a6e4/0x419e1ae1f6344d23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.293476:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.293478:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.293480:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788587300.293701:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587300.293708:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293717:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1788587300.293721:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587300.293725:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293734:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293742:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293749:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.293773:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587300.294090:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587300.294097:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.294106:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587300.294110:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.294119:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.294133:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.294154:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000147aa9c/0x419e1ae1f6344d2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.294171:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.294172:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.294174:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587300.296132:0:18542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:17087:x1875469310032384:12345-0@lo:5:osp-pre-1-1.0 Request processed in 69013us (69261us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788587300.296144:0:18542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00010000:3.0:1788587300.300505:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587300.300524:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.300541:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1788587300.300551:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587300.300558:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.300573:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.300584:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.300592:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.300620:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587300.302495:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587300.302508:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.302522:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587300.302527:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.302539:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.302560:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.302568:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024421068/0x419e1ae1f6344d31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.302605:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.302607:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.302608:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587300.308993:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17087:1875469310032384:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788587300.309014:0:17087:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788587300.309072:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17087:1875469310032640:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788587300.309139:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587300.309183:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587300.310813:0:16454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310032640 00000100:00100000:1.0:1788587300.310827:0:16454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310032640 00000100:00100000:1.0:1788587300.310883:0:16454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587300.310894:0:16454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17087:x1875469310032640:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788587300.310989:0:16454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17087:x1875469310032640:12345-0@lo:900:osp-pre-1-1.0 Request processed in 97us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.310997:0:16454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788587300.313113:0:17087:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0586d880 x1875469310032640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587316 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587300.313134:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17087:1875469310032640:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788587300.319229:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.319242:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319260:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.319265:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.319272:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319287:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319297:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319306:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319332:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587300.319357:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587300.319363:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319372:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ee00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587300.319377:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319387:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319405:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319413:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.319431:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.319432:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.319434:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.328322:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.328334:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.334899:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.334912:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.334921:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.334940:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.334950:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.334959:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.334979:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587300.334992:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587300.334997:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335004:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587300.335008:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335016:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335031:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335060:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000204bfeb8/0x419e1ae1f6344d3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335080:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.335082:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.335084:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.335820:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.335831:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335843:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.335847:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.335852:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335862:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335871:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335878:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.335898:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587300.335955:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587300.335963:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.335973:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587300.335978:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.335989:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.336007:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.336016:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082cc36c4/0x419e1ae1f6344d46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.336053:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.336056:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.336060:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.336395:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.336408:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336416:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.336419:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.336423:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336433:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336442:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336449:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336464:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587300.336474:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587300.336478:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336485:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587300.336489:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336496:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336516:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336523:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c414b984/0x419e1ae1f6344d4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.336539:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.336541:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.336544:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.337029:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.337037:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337047:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.337050:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.337055:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337064:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337072:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337079:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337107:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587300.337114:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587300.337121:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.337130:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587300.337134:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.337144:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.337166:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.337173:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede57622/0x419e1ae1f6344d54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.337191:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.337193:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.337196:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.337548:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.337554:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337562:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.337565:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.337569:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337578:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337587:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337593:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.337615:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587300.338032:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.338040:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.338050:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.338060:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.338064:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.338075:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.338083:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.338090:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.338100:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788587300.338885:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587300.338895:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.338919:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587300.338924:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.338934:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.338953:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.338961:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000373748ac/0x419e1ae1f6344d5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.338978:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587300.338981:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.338988:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587300.338991:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.338999:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.339009:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.339022:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e11177df/0x419e1ae1f6344d62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.339036:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.339037:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.339039:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.339135:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.340136:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.340145:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340159:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.340163:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.340169:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340181:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340191:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340207:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340224:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587300.340329:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587300.340335:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340352:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ee00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587300.340356:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340366:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340379:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340386:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b09a8288/0x419e1ae1f6344d69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.340402:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.340403:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.340405:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.341001:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.341016:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.341027:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.341031:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.341178:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.341190:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.341199:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.341206:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.341220:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587300.342180:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.342190:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.342200:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.342205:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.342214:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.342669:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.342693:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000836ff12d/0x419e1ae1f6344d70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.342717:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.342719:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.342721:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.343027:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.343212:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.343226:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.343230:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.343350:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.343364:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.343382:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.343390:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.343451:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587300.344070:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.344078:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.344090:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.344094:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.344099:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.344109:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.344118:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.344125:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344465:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587300.344472:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344481:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.344485:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344493:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344508:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344515:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004679ed6d/0x419e1ae1f6344d77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344532:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.344535:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344548:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.344551:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344558:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344568:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.344575:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.344577:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.344579:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.344683:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587300.344688:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000663a469a/0x419e1ae1f6344d7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587300.345493:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.345500:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.345512:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.345516:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.345521:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.345532:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.345539:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.345546:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.345601:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.345607:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.345615:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.345618:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.345626:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.345639:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.345709:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.345712:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.345714:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.345770:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587300.345775:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d42bab70/0x419e1ae1f6344d85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587300.346832:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.346841:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.346852:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.346856:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.346861:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.346872:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.346880:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.346886:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.347394:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.347402:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.347411:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.347415:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.347424:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.347441:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.347718:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.347720:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.347723:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.347755:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587300.347762:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000881a0a0d/0x419e1ae1f6344d8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587300.348701:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.348709:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.348733:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.348737:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.348743:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.348754:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.348763:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.348771:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.348912:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587300.352054:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.352071:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.352090:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.352096:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.352103:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.352117:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.352142:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.352151:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.352945:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587300.352955:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.352966:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.352970:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.352993:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.353011:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.353019:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c6bb2d6/0x419e1ae1f6344d93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.353060:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.353064:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.353071:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.353074:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.353082:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.353092:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.353099:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.353101:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.353109:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.353229:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587300.353245:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072fcdcb0/0x419e1ae1f6344d9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587300.353851:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.353857:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.353869:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.353873:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.353878:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.353889:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.353899:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.353919:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.353929:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587300.354400:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.354406:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354415:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.354419:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.354423:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354432:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354440:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354448:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354456:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788587300.354864:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.354870:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354884:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.354887:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.354890:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354899:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354908:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354915:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.354923:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788587300.355278:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.355284:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355292:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.355294:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.355298:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355306:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355322:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355329:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355336:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788587300.355704:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.355710:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355718:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.355721:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.355725:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355734:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355742:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355749:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.355767:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788587300.358808:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788587300.358821:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358835:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.358840:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358851:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358872:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358880:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000936e936c/0x419e1ae1f6344da1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358904:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788587300.358908:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358914:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.358917:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358924:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358943:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358950:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005218c1e9/0x419e1ae1f6344da8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358962:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788587300.358966:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358971:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.358975:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358981:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358990:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.358997:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082576329/0x419e1ae1f6344daf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359007:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587300.359010:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359022:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.359025:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359044:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359054:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359060:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009231fe1e/0x419e1ae1f6344db6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359072:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.359075:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359081:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.359085:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359092:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359100:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359112:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000422d5ce6/0x419e1ae1f6344dbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.359124:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.359126:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.359127:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.359375:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788587300.359747:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788587300.360732:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.360743:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.360765:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.360770:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.360776:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.360934:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.360945:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.360957:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.360982:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587300.361048:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587300.361058:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.361069:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587300.361073:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.361082:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.361103:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.361110:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc48c4b3/0x419e1ae1f6344dc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.361135:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.361136:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587300.361138:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587300.361938:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.362729:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.362749:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.362764:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.362774:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.362915:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.363197:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.363207:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.363234:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587300.363755:0:17753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587300.363761:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.363771:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788587300.363774:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587300.363779:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.363988:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587300.363995:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.364003:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587300.364008:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.364017:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.364043:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.364065:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b4603b9/0x419e1ae1f6344dcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.364088:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.364090:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587300.364091:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.364194:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.364204:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.364217:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.364232:0:17753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587300.364242:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587300.364247:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.364253:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587300.364256:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.364263:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.364273:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.364280:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046221832/0x419e1ae1f6344dd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.364294:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.364295:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587300.364297:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788587300.364543:0:17753:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1788587300.364640:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:16469:x1875469310031872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 142741us (155125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587300.364658:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587300.364779:0:16469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16469:1875469310031872:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788587300.364826:0:16469:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788587300.364875:0:16469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16469:1875469310032768:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788587300.364910:0:16469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587300.364938:0:16469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587300.365298:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310032768 00000100:00100000:1.0:1788587300.365306:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310032768 00000100:00100000:1.0:1788587300.365355:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587300.365364:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:16469:x1875469310032768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788587300.365398:0:17750:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1788587300.371301:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:16469:x1875469310032768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5931us (6383us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788587300.371315:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788587300.374571:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788587300.375317:0:16469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16469:1875469310032768:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788587300.375335:0:16469:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000004:00080000:2.0:1788587300.419714:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:3.0:1788587300.659142:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587300.845096:0:16439:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788587300.845103:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe05dae000 from 10 10000000:01000000:2.0:1788587300.845107:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587300.845146:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587300.845157:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587300.845167:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587300.845191:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310032896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587300.845259:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.845365:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f01540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587300.846036:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310032896 00000100:00100000:3.0:1788587300.846045:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310032896 00000100:00100000:3.0:1788587300.846090:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788587300.846100:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:16439:x1875469310032896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587300.846114:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587300.846131:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf2400/0x419e1ae1f6344de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344dd9 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.846156:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf2400/0x419e1ae1f6344de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344dd9 expref: 23 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.846167:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf3ccf2400/0x419e1ae1f6344de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344dd9 expref: 23 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587300.846175:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2400, rc 0) 00000100:00100000:3.0:1788587300.846233:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310032896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587300.846239:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788587300.846327:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310032896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587300.846353:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587300.846362:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587300.846417:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310033024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587300.846455:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587300.846486:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10f143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587300.846639:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310033024 00000100:00100000:3.0:1788587300.846643:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310033024 00000100:00100000:3.0:1788587300.846871:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788587300.846880:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310033024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788587300.846895:0:16435:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788587300.846910:0:16435:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788587300.846914:0:16435:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788587300.846994:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310033024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587300.847002:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788587300.848963:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310033024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788587300.849041:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587300.849051:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.849062:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587300.849073:0:16439:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788587300.849075:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe04f8d000 from 10 10000000:01000000:1.0:1788587300.849078:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788587300.849111:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.849119:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.849127:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587300.849150:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310033152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587300.849199:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.851954:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03634a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587300.852302:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310033152 00000100:00100000:2.0:1788587300.852320:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310033152 00000100:00100000:2.0:1788587300.852393:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587300.852403:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310033152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587300.852418:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587300.852435:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6344dee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344de7 expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587300.852461:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6344dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344de7 expref: 24 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587300.852843:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6344dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344de7 expref: 24 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587300.852853:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044400, rc 0) 00000100:00100000:2.0:1788587300.853082:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:16439:x1875469310033152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 681us (3882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587300.853087:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788587300.853415:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310033152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587300.853436:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.853447:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587300.853516:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310033280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788587300.853560:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587300.853589:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03634a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587300.853644:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310033280 00000100:00100000:0.0:1788587300.853649:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310033280 00000100:00100000:0.0:1788587300.853719:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788587300.853729:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:16439:x1875469310033280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587300.853745:0:16436:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587300.853762:0:16436:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587300.853766:0:16436:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788587300.853863:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:16439:x1875469310033280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587300.853870:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587300.853936:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310033280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788587300.853999:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587300.854006:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587300.854014:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587300.907938:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587300.907965:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310033408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587300.908050:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587300.908215:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310033408 00000100:00100000:3.0:1788587300.908223:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310033408 00000100:00100000:3.0:1788587300.908279:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587300.908297:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310033408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587300.908334:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587300.908399:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310033408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587300.908406:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587300.908452:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310033408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587300.911418:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587300.911441:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310033536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587300.911507:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587300.913926:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310033536 00000100:00100000:2.0:1788587300.913939:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310033536 00000100:00100000:2.0:1788587300.913987:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587300.913997:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310033536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587300.914082:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788587300.914220:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310033536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 224us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587300.914228:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587300.914329:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310033536:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788587301.681506:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788587302.542181:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788587302.542201:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1788587302.699172:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587303.725975:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788587304.488686:0:18828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788587304.491096:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310033664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587304.491165:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587304.491223:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310033664 00000100:00100000:2.0:1788587304.491230:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310033664 00000100:00100000:2.0:1788587304.491306:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587304.491326:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310033664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587304.491359:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587304.491404:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310033664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587304.491411:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788587304.491469:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587304.491509:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310033664:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788587304.583272:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00080000:1.0:1788587304.583290:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:1.0:1788587304.583428:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788587304.583434:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788587304.746941:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587305.515557:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310033792:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.515629:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587305.515683:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310034304:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.515709:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587305.515728:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0815aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310034816:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.515753:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587305.515768:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310035328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.516011:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310033920:0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.516045:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587305.516066:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310034432:0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.516087:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587305.516110:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469310034944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587305.516229:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310033792 00000100:00100000:0.0:1788587305.516238:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310033792 00000100:00100000:0.0:1788587305.516288:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788587305.516297:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3474:x1875469310033792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.516370:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587305.517076:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3474:x1875469310033792:12345-0@lo:400:kworker.0 Request processed in 776us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587305.517092:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587305.517438:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310033792:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.517468:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310034048:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.517498:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587305.517600:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587305.517702:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0815a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310034560:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.517727:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587305.517950:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310035456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587305.517987:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587305.518365:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310034304 00000100:00100000:3.0:1788587305.518373:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310034304 00000100:00100000:3.0:1788587305.518405:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310034816 00000100:00100000:3.0:1788587305.518407:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310034816 00000100:00100000:3.0:1788587305.518418:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310035328 00000100:00100000:3.0:1788587305.518420:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310035328 00000100:00100000:3.0:1788587305.518445:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310034944 00000100:00100000:3.0:1788587305.518448:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310034944 00000100:00100000:3.0:1788587305.518463:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587305.518471:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310034304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587305.518531:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310034304:12345-0@lo:400:kworker.0 Request processed in 60us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587305.518537:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587305.518565:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587305.518571:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310034816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587305.518599:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310034816:12345-0@lo:400:kworker.0 Request processed in 28us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587305.518605:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587305.518615:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587305.518621:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469310035328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587305.518644:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469310035328:12345-0@lo:400:kworker.0 Request processed in 24us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587305.518650:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587305.518663:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587305.518668:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469310034944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587305.518700:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469310034944:12345-0@lo:400:kworker.0 Request processed in 32us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587305.518706:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587305.519858:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310033920 00000100:00100000:2.0:1788587305.519868:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310033920 00000100:00100000:2.0:1788587305.519901:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310034432 00000100:00100000:2.0:1788587305.519914:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310034432 00000100:00100000:2.0:1788587305.519932:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587305.519939:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310033920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.519999:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310033920:12345-0@lo:400:kworker.0 Request processed in 60us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587305.520006:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587305.520022:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587305.520027:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310034432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.520054:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310034432:12345-0@lo:400:kworker.0 Request processed in 27us (3966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587305.520072:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587305.520098:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310035456 00000100:00100000:2.0:1788587305.520102:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310035456 00000100:00100000:2.0:1788587305.520140:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587305.520148:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310035456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587305.520175:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587305.520208:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310035456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587305.520214:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587305.520260:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310033920:0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.520271:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310034432:0@lo:400:kworker.0 00010000:00080000:2.0:1788587305.520286:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf08159f80 x1875469310034944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587305.520297:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469310034944:0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.520315:0:3475:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788587305.520336:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310035456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587305.521381:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0815b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310035072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.521442:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587305.521459:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf08159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310035584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587305.521483:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587305.521507:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788587305.521527:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310034176:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.521550:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587305.521591:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310035072 00000100:00100000:3.0:1788587305.521598:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310035072 00000100:00100000:3.0:1788587305.521643:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788587305.521652:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310035072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587305.521694:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310035072:12345-0@lo:400:kworker.0 Request processed in 44us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587305.521701:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587305.521825:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310034048 00000100:00100000:0.0:1788587305.521834:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310034048 00000100:00100000:2.0:1788587305.521949:0:18542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310034560 00000100:00100000:2.0:1788587305.521955:0:18542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310034560 00000100:00100000:2.0:1788587305.522010:0:18542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587305.522017:0:18542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310034048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.522056:0:18542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310034048:12345-0@lo:400:kworker.0 Request processed in 40us (4558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587305.522062:0:18542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587305.522075:0:18542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587305.522088:0:18542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310034560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.522118:0:18542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310034560:12345-0@lo:400:kworker.0 Request processed in 31us (4390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587305.522668:0:18542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587305.523269:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310035584 00000100:00100000:2.0:1788587305.523277:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310035584 00000100:00100000:1.0:1788587305.523398:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0815b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310034688:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.523440:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587305.523457:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0815a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469310035200:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.523505:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587305.523556:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310034048:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.523568:0:3472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788587305.523584:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0815a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310034560:0@lo:400:kworker.0 00010000:00080000:1.0:1788587305.523596:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf0815b100 x1875469310035072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587305.523606:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0815b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310035072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.523637:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310034176 00000100:00100000:1.0:1788587305.523641:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310034176 00000100:00100000:1.0:1788587305.523670:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310034688 00000100:00100000:1.0:1788587305.523672:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310034688 00000100:00100000:1.0:1788587305.523689:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587305.523696:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310034176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.523741:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310034176:12345-0@lo:400:kworker.0 Request processed in 45us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587305.523758:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587305.523772:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587305.523778:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310034688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.523822:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310034688:12345-0@lo:400:kworker.0 Request processed in 44us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587305.523829:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587305.523845:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310035200 00000100:00100000:1.0:1788587305.523848:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310035200 00000100:00100000:1.0:1788587305.523876:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587305.523883:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469310035200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587305.524064:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587305.524073:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310035584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587305.524092:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587305.524137:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310035584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587305.524144:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587305.524322:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469310035200:12345-0@lo:400:kworker.0 Request processed in 439us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587305.524330:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587305.524370:0:3472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788587305.524383:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310034176:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.524394:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0815b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310034688:0@lo:400:kworker.0 00010000:00080000:1.0:1788587305.524405:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf0815a680 x1875469310035200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587305.524414:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0815a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469310035200:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.524428:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310035584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788587305.524684:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587305.524689:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587305.524692:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587305.524695:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587305.524768:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:2.0:1788587305.524835:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf08158380 x1875469310034304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587305.524846:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310034304:0@lo:400:kworker.0 00010000:00080000:2.0:1788587305.524859:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf0815aa00 x1875469310034816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587305.524867:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0815aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310034816:0@lo:400:kworker.0 00010000:00080000:2.0:1788587305.524879:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf08158700 x1875469310035328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587305.524887:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf08158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310035328:0@lo:400:kworker.0 00000100:00100000:1.0:1788587305.527701:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310035712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587305.527861:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587305.527927:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310035712 00000100:00100000:2.0:1788587305.527935:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310035712 00000100:00100000:2.0:1788587305.527990:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587305.528000:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310035712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587305.528024:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587305.528079:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310035712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587305.528086:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587305.528664:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310035712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587305.772659:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587306.028069:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587306.028089:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310035840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587306.028153:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587306.028321:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310035840 00000100:00100000:3.0:1788587306.028329:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310035840 00000100:00100000:3.0:1788587306.028386:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788587306.028396:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310035840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587306.028448:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587306.028504:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310035840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587306.028511:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788587306.028566:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310035840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587306.029835:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587306.029849:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0815bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310035968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587306.029908:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587306.029991:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310035968 00000100:00100000:0.0:1788587306.029998:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310035968 00000100:00100000:0.0:1788587306.030038:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587306.030047:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310035968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587306.030075:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587306.030129:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310035968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.030142:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788587306.031558:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0815bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310035968:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788587306.155586:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587306.377439:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587306.377520:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292127104 00000100:00100000:3.0:1788587306.377529:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292127104 00000100:00100000:3.0:1788587306.377613:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:3.0:1788587306.377621:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2408:x1875469292127104:12345-192.168.203.14@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788587306.377648:0:16435:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed@192.168.203.14@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1788587306.377676:0:16435:0:(genops.c:1385:class_connect()) connect: client 330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed, cookie 0x419e1ae1f6344df5 00000100:00080000:3.0:1788587306.377843:0:16435:0:(import.c:65:import_set_state_nolock()) ffff8cbf3c2b4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587306.377906:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+5:2408:x1875469292127104:12345-192.168.203.14@tcp:250:mount.lustre.0 Request processed in 284us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587306.377914:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:1.0:1788587306.381673:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.381940:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292127232 00000100:00100000:0.0:1788587306.382013:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292127232 00000100:00100000:0.0:1788587306.382066:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 113 00000100:00100000:0.0:1788587306.382074:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+5:15049:x1875469292127232:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587306.382088:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587306.382105:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ba9 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.382129:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ba9 expref: 6 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.382141:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ba9 expref: 6 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.382150:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26400, rc 0) 00000100:00100000:0.0:1788587306.382630:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+6:15049:x1875469292127232:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 553us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.382638:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 113 00000100:00100000:1.0:1788587306.389459:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587306.389544:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292127360 00000100:00100000:3.0:1788587306.389554:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292127360 00000100:00100000:3.0:1788587306.389612:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:3.0:1788587306.389622:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cced450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+6:15049:x1875469292127360:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788587306.390065:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cced450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+6:15049:x1875469292127360:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 443us (614us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587306.390081:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:2.0:1788587306.393121:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.393226:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292127488 00000100:00100000:0.0:1788587306.393235:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292127488 00000100:00100000:0.0:1788587306.393287:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:0.0:1788587306.393296:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+6:15049:x1875469292127488:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587306.393321:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587306.393338:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26a00/0x419e1ae1f6344e03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5bb0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.393386:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26a00/0x419e1ae1f6344e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5bb0 expref: 7 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.393397:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26a00/0x419e1ae1f6344e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5bb0 expref: 7 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.393407:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26a00, rc 0) 00000100:00100000:0.0:1788587306.393468:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+7:15049:x1875469292127488:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 173us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.393475:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:2.0:1788587306.395585:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587306.395674:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292127616 00000100:00100000:1.0:1788587306.395683:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292127616 00000100:00100000:1.0:1788587306.395736:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:1.0:1788587306.395746:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+7:15049:x1875469292127616:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788587306.396065:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15049:x1875469292127616:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 319us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587306.396072:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:1.0:1788587306.399578:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587306.399837:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292127744 00000100:00100000:3.0:1788587306.399847:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292127744 00000100:00100000:3.0:1788587306.399914:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:3.0:1788587306.399925:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15049:x1875469292127744:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788587306.402240:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15049:x1875469292127744:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 2306us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587306.402256:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:2.0:1788587306.406211:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.406328:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292127872 00000100:00100000:0.0:1788587306.406339:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292127872 00000100:00100000:0.0:1788587306.406407:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:0.0:1788587306.406417:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15067:x1875469292127872:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587306.406825:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15067:x1875469292127872:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 374us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.406834:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:2.0:1788587306.424531:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587306.428003:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292128000 00000100:00100000:3.0:1788587306.428020:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292128000 00000100:00100000:3.0:1788587306.428081:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:3.0:1788587306.428091:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15067:x1875469292128000:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587306.430147:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15067:x1875469292128000:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 2046us (5614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587306.430162:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:2.0:1788587306.435556:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587306.435657:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292128128 00000100:00100000:1.0:1788587306.435668:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292128128 00000100:00100000:1.0:1788587306.435728:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:1.0:1788587306.435738:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15067:x1875469292128128:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587306.436118:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15067:x1875469292128128:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 380us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587306.436127:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:1.0:1788587306.441255:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587306.443137:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292128256 00000100:00100000:2.0:1788587306.443151:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292128256 00000100:00100000:2.0:1788587306.443208:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:2.0:1788587306.443218:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:15049:x1875469292128256:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587306.443233:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587306.443251:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f6344e0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5be1 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587306.443279:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f6344e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be1 expref: 9 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587306.443318:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f6344e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be1 expref: 9 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587306.443327:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045e00, rc 0) 00000100:00100000:2.0:1788587306.443392:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+9:15049:x1875469292128256:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 175us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587306.443400:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:2.0:1788587306.446020:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587306.446113:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292128384 00000100:00100000:1.0:1788587306.446121:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292128384 00000100:00100000:1.0:1788587306.446185:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:1.0:1788587306.446195:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+9:15049:x1875469292128384:12345-192.168.203.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788587306.446221:0:16437:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788587306.446238:0:16437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788587306.446241:0:16437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788587306.446256:0:16437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788587306.446258:0:16437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788587306.446261:0:16437:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788587306.455213:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+9:15049:x1875469292128384:12345-192.168.203.14@tcp:256:mount.lustre.0 Request processed in 9005us (9189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.455231:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:2.0:1788587306.458449:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.458548:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292128512 00000100:00100000:0.0:1788587306.458557:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292128512 00000100:00100000:0.0:1788587306.458827:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:0.0:1788587306.458838:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+9:15049:x1875469292128512:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587306.458855:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587306.458954:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5be8 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.458983:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 10 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.458995:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 10 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.459005:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27000, rc 0) 00000100:00100000:0.0:1788587306.459644:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15049:x1875469292128512:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 805us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.459652:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:2.0:1788587306.466997:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.467088:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292128640 00000100:00100000:0.0:1788587306.467097:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292128640 00000100:00100000:0.0:1788587306.467149:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:0.0:1788587306.467159:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15049:x1875469292128640:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587306.471185:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15049:x1875469292128640:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 4017us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.471198:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:1.0:1788587306.474901:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.474977:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292128768 00000100:00100000:0.0:1788587306.474986:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292128768 00000100:00100000:0.0:1788587306.475044:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:0.0:1788587306.475055:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15049:x1875469292128768:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788587306.475633:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15049:x1875469292128768:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 578us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.475641:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:1.0:1788587306.484660:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587306.485015:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292128896 00000100:00100000:2.0:1788587306.485025:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292128896 00000100:00100000:2.0:1788587306.485087:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:2.0:1788587306.485097:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15070:x1875469292128896:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587306.485388:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15070:x1875469292128896:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 292us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587306.485397:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:2.0:1788587306.488476:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.494686:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292129024 00000100:00100000:0.0:1788587306.494704:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292129024 00000100:00100000:0.0:1788587306.494775:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 127 00000100:00100000:0.0:1788587306.494785:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15070:x1875469292129024:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587306.495249:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15070:x1875469292129024:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 464us (6782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.495258:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 127 00000100:00100000:3.0:1788587306.509439:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587306.509679:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292129152 00000100:00100000:1.0:1788587306.509690:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292129152 00000100:00100000:1.0:1788587306.509733:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788587306.509742:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875469292129152:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788587306.510207:0:16443:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 105a14ca-5728-4c79-85fc-db7f7cf354e5@192.168.203.14@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:1.0:1788587306.510259:0:16443:0:(genops.c:1385:class_connect()) connect: client 105a14ca-5728-4c79-85fc-db7f7cf354e5, cookie 0x419e1ae1f6344e18 00000004:00100000:1.0:1788587306.510291:0:16443:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788587306.513201:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00080000:1.0:1788587306.513713:0:16443:0:(import.c:65:import_set_state_nolock()) ffff8cbf39156000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587306.514400:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292129408 00000100:00100000:0.0:1788587306.514409:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292129408 00000100:00100000:0.0:1788587306.514450:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788587306.514459:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875469292129408:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788587306.514484:0:16444:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 105a14ca-5728-4c79-85fc-db7f7cf354e5@192.168.203.14@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788587306.514528:0:16444:0:(genops.c:1385:class_connect()) connect: client 105a14ca-5728-4c79-85fc-db7f7cf354e5, cookie 0x419e1ae1f6344e1f 00000004:00100000:0.0:1788587306.514553:0:16444:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788587306.514852:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2408:x1875469292129152:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 5107us (5421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587306.514862:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00080000:0.0:1788587306.515142:0:16444:0:(import.c:65:import_set_state_nolock()) ffff8cbe053cd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587306.515236:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2408:x1875469292129408:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 776us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.515245:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:3.0:1788587306.521102:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587306.521611:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587306.522248:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.522376:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292129280 00000100:00100000:0.0:1788587306.522386:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292129280 00000100:00080000:0.0:1788587306.523216:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587306.528316:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292129664 00000100:00100000:2.0:1788587306.528332:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292129664 00000100:00100000:2.0:1788587306.528376:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292129536 00000100:00100000:2.0:1788587306.528379:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292129536 00000100:00100000:2.0:1788587306.528414:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788587306.528424:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:0:x1875469292129280:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788587306.528466:0:16442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587306.528696:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:0:x1875469292129280:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 272us (7603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587306.528703:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788587306.528735:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788587306.528742:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15049:x1875469292129664:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788587306.528753:0:16442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587306.528777:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15049:x1875469292129664:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 35us (7168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587306.528783:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788587306.528813:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788587306.528832:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:0:x1875469292129536:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788587306.528852:0:16442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788587306.528890:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:0:x1875469292129536:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 69us (6643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587306.528896:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00080000:2.0:1788587306.528914:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587306.533686:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587306.534653:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292129792 00000100:00100000:2.0:1788587306.534665:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292129792 00000100:00100000:2.0:1788587306.534741:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788587306.534752:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15049:x1875469292129792:12345-192.168.203.14@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788587306.534860:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15049:x1875469292129792:12345-192.168.203.14@tcp:40:mount.lustre.0 Request processed in 110us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587306.534867:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788587306.540722:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587306.540762:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.540920:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292129920 00000100:00100000:0.0:1788587306.540929:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292129920 00000100:00100000:0.0:1788587306.540966:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:0.0:1788587306.540975:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2408:x1875469292129920:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788587306.541008:0:17877:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 105a14ca-5728-4c79-85fc-db7f7cf354e5@192.168.203.14@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788587306.541042:0:17877:0:(genops.c:1385:class_connect()) connect: client 105a14ca-5728-4c79-85fc-db7f7cf354e5, cookie 0x419e1ae1f6344e26 00002000:00100000:0.0:1788587306.541054:0:17877:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 105a14ca-5728-4c79-85fc-db7f7cf354e5/ffff8cbf164fc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788587306.541077:0:17877:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788587306.541460:0:17877:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788587306.541490:0:17877:0:(import.c:65:import_set_state_nolock()) ffff8cbe044f8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587306.541558:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2408:x1875469292129920:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 583us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.541567:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587306.541642:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587306.541928:0:16454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292130176 00000100:00100000:1.0:1788587306.541935:0:16454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292130176 00000100:00100000:1.0:1788587306.541977:0:16454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587306.541985:0:16454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15049:x1875469292130176:12345-192.168.203.14@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788587306.542041:0:16454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15049:x1875469292130176:12345-192.168.203.14@tcp:900:mount.lustre.0 Request processed in 57us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587306.542056:0:16454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788587306.542287:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292130048 00000100:00100000:0.0:1788587306.542292:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292130048 00000100:00100000:0.0:1788587306.542330:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:0.0:1788587306.542335:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1875469292130048:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788587306.542354:0:17750:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 105a14ca-5728-4c79-85fc-db7f7cf354e5@192.168.203.14@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788587306.542375:0:17750:0:(genops.c:1385:class_connect()) connect: client 105a14ca-5728-4c79-85fc-db7f7cf354e5, cookie 0x419e1ae1f6344e2d 00002000:00100000:0.0:1788587306.542383:0:17750:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 105a14ca-5728-4c79-85fc-db7f7cf354e5/ffff8cbe044ff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788587306.542390:0:17750:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788587306.542650:0:17750:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788587306.542673:0:17750:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587306.542716:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2408:x1875469292130048:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 379us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.542724:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788587306.543614:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587306.544132:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292130304 00000100:00100000:1.0:1788587306.544140:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292130304 00000100:00100000:1.0:1788587306.544187:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:1.0:1788587306.544197:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15049:x1875469292130304:12345-192.168.203.14@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788587306.547035:0:16445:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2778us 00000004:00200000:2.0:1788587306.563670:0:16445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788587306.563827:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15049:x1875469292130304:12345-192.168.203.14@tcp:33:mount.lustre.0 Request processed in 19626us (20210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587306.563842:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788587306.754138:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587306.754383:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292130432 00000100:00100000:0.0:1788587306.754393:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292130432 00000100:00100000:0.0:1788587306.754457:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788587306.754469:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15093:x1875469292130432:12345-192.168.203.14@tcp:101:mkdir.0 00010000:00010000:0.0:1788587306.754505:0:16443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587306.754641:0:16443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5c19 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.754709:0:16443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6344e3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.754722:0:16443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6344e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.754736:0:16443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6344e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587306.754767:0:16443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587306.754771:0:16443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587306.754835:0:16443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6344e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.754863:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6344e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c19 expref: 8 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.754883:0:16443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6344e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c19 expref: 7 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587306.754892:0:16443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:0.0:1788587306.754896:0:16443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587306.754899:0:16443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26800, rc 0) 00000100:00100000:0.0:1788587306.754997:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:15093:x1875469292130432:12345-192.168.203.14@tcp:101:mkdir.0 Request processed in 530us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587306.755013:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00010000:00010000:3.0:1788587306.796687:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587307.602747:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 105a14ca-5728-4c79-85fc-db7f7cf354e5 00010000:00010000:0.0:1788587307.819907:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587307.948005:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788587308.601036:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587308.601883:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292130560 00000100:00100000:1.0:1788587308.601894:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292130560 00000100:00100000:1.0:1788587308.601974:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:1.0:1788587308.601984:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:15145:x1875469292130560:12345-192.168.203.14@tcp:41:lfs.0 00000004:00000024:1.0:1788587308.602027:0:16442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587308.602150:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:15145:x1875469292130560:12345-192.168.203.14@tcp:41:lfs.0 Request processed in 167us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587308.602157:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00080000:2.0:1788587308.602893:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587308.613122:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587308.613462:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292130688 00000100:00100000:3.0:1788587308.613473:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292130688 00000100:00080000:2.0:1788587308.613603:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587308.613671:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788587308.613683:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15145:x1875469292130688:12345-192.168.203.14@tcp:41:lfs.0 00000004:00000024:3.0:1788587308.613747:0:16444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788587308.613912:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15145:x1875469292130688:12345-192.168.203.14@tcp:41:lfs.0 Request processed in 232us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587308.613920:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:0.0:1788587308.625253:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.625368:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292130816 00000100:00100000:2.0:1788587308.625379:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292130816 00000100:00100000:2.0:1788587308.625462:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788587308.625472:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:15145:x1875469292130816:12345-192.168.203.14@tcp:13:lfs.0 00002000:00000024:2.0:1788587308.625674:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587308.625772:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:15145:x1875469292130816:12345-192.168.203.14@tcp:13:lfs.0 Request processed in 301us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.625782:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00080000:0.0:1788587308.626486:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587308.627698:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.628088:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292130944 00000100:00100000:0.0:1788587308.628098:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292130944 00000100:00100000:0.0:1788587308.628169:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:0.0:1788587308.628180:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15145:x1875469292130944:12345-192.168.203.14@tcp:13:lfs.0 00002000:00000024:0.0:1788587308.628216:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587308.628302:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15145:x1875469292130944:12345-192.168.203.14@tcp:13:lfs.0 Request processed in 123us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.628310:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00080000:2.0:1788587308.628936:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587308.822177:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.822341:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292131072 00000100:00100000:0.0:1788587308.822352:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292131072 00000100:00100000:0.0:1788587308.822410:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:0.0:1788587308.822420:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:15178:x1875469292131072:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587308.822447:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587308.822465:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5c20 expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587308.822495:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c20 expref: 11 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587308.822506:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c20 expref: 11 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587308.822532:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26000, rc 0) 00000100:00100000:0.0:1788587308.822591:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15178:x1875469292131072:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 172us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.822603:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:1.0:1788587308.831454:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.831739:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292131200 00000100:00100000:0.0:1788587308.831748:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292131200 00000100:00100000:0.0:1788587308.831835:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:0.0:1788587308.831846:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15178:x1875469292131200:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587308.832155:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15178:x1875469292131200:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 309us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.832934:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:1.0:1788587308.842012:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.844294:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292131328 00000100:00100000:2.0:1788587308.844309:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292131328 00000100:00100000:2.0:1788587308.844423:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:2.0:1788587308.844441:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15178:x1875469292131328:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587308.845052:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15178:x1875469292131328:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 614us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.845062:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 130 00010000:00010000:3.0:1788587308.846411:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587308.848955:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.849055:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292131456 00000100:00100000:0.0:1788587308.849063:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292131456 00000100:00100000:0.0:1788587308.849117:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:0.0:1788587308.849126:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15184:x1875469292131456:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587308.849890:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15184:x1875469292131456:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 761us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.849900:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:1.0:1788587308.869032:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.869116:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292131584 00000100:00100000:2.0:1788587308.869126:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292131584 00000100:00100000:2.0:1788587308.869185:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:2.0:1788587308.869194:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15184:x1875469292131584:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587308.869600:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15184:x1875469292131584:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 405us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.869608:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:2.0:1788587308.874394:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.874507:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292131712 00000100:00100000:0.0:1788587308.874517:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292131712 00000100:00100000:0.0:1788587308.874573:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:0.0:1788587308.874584:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15184:x1875469292131712:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587308.874860:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15184:x1875469292131712:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 276us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.874883:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:3.0:1788587308.881917:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.882092:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292131840 00000100:00100000:2.0:1788587308.882103:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292131840 00000100:00100000:2.0:1788587308.882162:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:2.0:1788587308.882305:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15178:x1875469292131840:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587308.882323:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587308.882341:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044800/0x419e1ae1f6344e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5c51 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587308.882371:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044800/0x419e1ae1f6344e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c51 expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587308.882383:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044800/0x419e1ae1f6344e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c51 expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587308.882392:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044800, rc 0) 00000100:00100000:2.0:1788587308.882456:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15178:x1875469292131840:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 154us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.884335:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:3.0:1788587308.884883:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587308.885188:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292131968 00000100:00100000:1.0:1788587308.885196:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292131968 00000100:00100000:1.0:1788587308.885279:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:1.0:1788587308.885301:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15178:x1875469292131968:12345-192.168.203.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788587308.885341:0:16437:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788587308.885368:0:16437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788587308.885372:0:16437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788587308.885375:0:16437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788587308.885378:0:16437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788587308.885380:0:16437:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788587308.888381:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15178:x1875469292131968:12345-192.168.203.14@tcp:256:mount.lustre.0 Request processed in 3071us (3489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.888396:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:3.0:1788587308.891111:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.891465:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292132096 00000100:00100000:2.0:1788587308.891474:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292132096 00000100:00100000:2.0:1788587308.891650:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:2.0:1788587308.891662:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15178:x1875469292132096:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587308.891714:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587308.891732:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5c58 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587308.891772:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 13 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587308.891783:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 13 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587308.891815:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044600, rc 0) 00000100:00100000:2.0:1788587308.891879:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15178:x1875469292132096:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 219us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.891886:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:3.0:1788587308.894102:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.894458:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292132224 00000100:00100000:0.0:1788587308.894469:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292132224 00000100:00100000:0.0:1788587308.894534:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 137 00000100:00100000:0.0:1788587308.894545:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15178:x1875469292132224:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587308.895105:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15178:x1875469292132224:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 559us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.895114:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 137 00000100:00100000:1.0:1788587308.897379:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.897467:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292132352 00000100:00100000:2.0:1788587308.897476:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292132352 00000100:00100000:2.0:1788587308.897539:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:2.0:1788587308.897550:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15178:x1875469292132352:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587308.897924:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15178:x1875469292132352:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 375us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.897932:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:3.0:1788587308.902111:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.902215:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292132480 00000100:00100000:0.0:1788587308.902224:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292132480 00000100:00100000:0.0:1788587308.902292:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:0.0:1788587308.902302:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15188:x1875469292132480:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587308.902592:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15188:x1875469292132480:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 290us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.902601:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:3.0:1788587308.910614:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.910767:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292132608 00000100:00100000:0.0:1788587308.910778:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292132608 00000100:00100000:0.0:1788587308.910856:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 140 00000100:00100000:0.0:1788587308.910867:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15188:x1875469292132608:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587308.911120:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15188:x1875469292132608:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 254us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.911138:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 140 00000100:00100000:1.0:1788587308.913941:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.916883:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292132736 00000100:00100000:2.0:1788587308.916900:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292132736 00000100:00100000:2.0:1788587308.916955:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:2.0:1788587308.916964:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875469292132736:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587308.916994:0:16442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2a3fdddd-8216-4b58-9628-ff883535a8b8@192.168.203.14@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1788587308.917048:0:16442:0:(genops.c:1385:class_connect()) connect: client 2a3fdddd-8216-4b58-9628-ff883535a8b8, cookie 0x419e1ae1f6344e57 00000004:00100000:2.0:1788587308.917093:0:16442:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587308.917225:0:16442:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587308.923208:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2408:x1875469292132736:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 6228us (9261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.923226:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:1.0:1788587308.931906:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.933101:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292132992 00000100:00100000:0.0:1788587308.933113:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292132992 00000100:00100000:0.0:1788587308.933174:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:0.0:1788587308.933182:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875469292132992:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788587308.933219:0:16444:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2a3fdddd-8216-4b58-9628-ff883535a8b8@192.168.203.14@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1788587308.933259:0:16444:0:(genops.c:1385:class_connect()) connect: client 2a3fdddd-8216-4b58-9628-ff883535a8b8, cookie 0x419e1ae1f6344e5e 00000004:00100000:0.0:1788587308.933303:0:16444:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788587308.933674:0:16444:0:(import.c:65:import_set_state_nolock()) ffff8cbf3b2fb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587308.933743:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2408:x1875469292132992:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 559us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.933752:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587308.945134:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.945220:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587308.946026:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292132864 00000100:00100000:3.0:1788587308.946036:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292132864 00000100:00100000:2.0:1788587308.946382:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292133248 00000100:00100000:2.0:1788587308.946387:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292133248 00000100:00100000:2.0:1788587308.946417:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788587308.946427:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+7:0:x1875469292132864:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788587308.946461:0:17774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587308.946544:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+7:0:x1875469292132864:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 117us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.946551:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788587308.946568:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788587308.946575:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15178:x1875469292133248:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788587308.946586:0:17774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587308.946607:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15178:x1875469292133248:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 33us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.946614:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:1.0:1788587308.948300:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587308.948935:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587308.949034:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292133376 00000100:00100000:3.0:1788587308.949043:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292133376 00000100:00100000:3.0:1788587308.949129:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292133120 00000100:00100000:3.0:1788587308.949133:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292133120 00000100:00100000:1.0:1788587308.949170:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:1.0:1788587308.949183:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15178:x1875469292133376:12345-192.168.203.14@tcp:40:mount.lustre.0 00000100:00080000:0.0:1788587308.949464:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587308.949469:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587308.950117:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15178:x1875469292133376:12345-192.168.203.14@tcp:40:mount.lustre.0 Request processed in 932us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587308.950129:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:3.0:1788587308.952135:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:3.0:1788587308.952150:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:0:x1875469292133120:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587308.952181:0:16444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788587308.952255:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:0:x1875469292133120:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 110us (3322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587308.952262:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:1.0:1788587308.957476:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587308.957523:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587308.957562:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587308.957649:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292133504 00000100:00100000:2.0:1788587308.957659:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292133504 00000100:00100000:2.0:1788587308.957699:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292133632 00000100:00100000:2.0:1788587308.957702:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292133632 00000100:00100000:3.0:1788587308.957715:0:16454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292133760 00000100:00100000:3.0:1788587308.957722:0:16454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292133760 00000100:00100000:2.0:1788587308.957748:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788587308.957756:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1875469292133504:12345-192.168.203.14@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788587308.957766:0:16454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788587308.957774:0:16454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15178:x1875469292133760:12345-192.168.203.14@tcp:900:mount.lustre.0 00010000:00080000:2.0:1788587308.957790:0:17753:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2a3fdddd-8216-4b58-9628-ff883535a8b8@192.168.203.14@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1788587308.957853:0:17753:0:(genops.c:1385:class_connect()) connect: client 2a3fdddd-8216-4b58-9628-ff883535a8b8, cookie 0x419e1ae1f6344e65 00002000:00100000:2.0:1788587308.957864:0:17753:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a3fdddd-8216-4b58-9628-ff883535a8b8/ffff8cbf10d09000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788587308.957879:0:16454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15178:x1875469292133760:12345-192.168.203.14@tcp:900:mount.lustre.0 Request processed in 105us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587308.957888:0:16454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00002000:00100000:2.0:1788587308.957888:0:17753:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788587308.957916:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:3.0:1788587308.957921:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1875469292133632:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788587308.957940:0:17751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2a3fdddd-8216-4b58-9628-ff883535a8b8@192.168.203.14@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1788587308.957960:0:17751:0:(genops.c:1385:class_connect()) connect: client 2a3fdddd-8216-4b58-9628-ff883535a8b8, cookie 0x419e1ae1f6344e6c 00002000:00100000:3.0:1788587308.957967:0:17751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a3fdddd-8216-4b58-9628-ff883535a8b8/ffff8cbf3c2b0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587308.957974:0:17751:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587308.958066:0:17751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:2.0:1788587308.958074:0:17753:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587308.958096:0:17751:0:(import.c:65:import_set_state_nolock()) ffff8cbf3c2b3800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788587308.958099:0:17753:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587308.958130:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2408:x1875469292133632:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 206us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587308.958139:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2408:x1875469292133504:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 381us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587308.958140:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:2.0:1788587308.958152:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788587308.969251:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587308.969380:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292133888 00000100:00100000:0.0:1788587308.969390:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292133888 00000100:00100000:0.0:1788587308.969449:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:0.0:1788587308.969459:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15178:x1875469292133888:12345-192.168.203.14@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788587308.969560:0:16446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788587308.969648:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15178:x1875469292133888:12345-192.168.203.14@tcp:33:mount.lustre.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587308.969656:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:1.0:1788587309.132867:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587309.133310:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292134016 00000100:00100000:2.0:1788587309.133320:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292134016 00000100:00100000:2.0:1788587309.133385:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788587309.133394:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15211:x1875469292134016:12345-192.168.203.14@tcp:101:mkdir.0 00010000:00010000:2.0:1788587309.133415:0:17774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587309.133437:0:17774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6344e73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5c89 expref: -99 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587309.133569:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587309.133582:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587309.133593:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587309.133641:0:17774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587309.133646:0:17774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587309.133683:0:17774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587309.133711:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6344e73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 8 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587309.133729:0:17774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 7 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587309.133738:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587309.133741:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587309.133745:0:17774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044c00, rc 0) 00000100:00100000:2.0:1788587309.133859:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+7:15211:x1875469292134016:12345-192.168.203.14@tcp:101:mkdir.0 Request processed in 465us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587309.133866:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788587309.611940:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587309.611963:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310036096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587309.612030:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587309.613469:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310036096 00000100:00100000:2.0:1788587309.613485:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310036096 00000100:00100000:2.0:1788587309.613546:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587309.613557:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310036096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587309.613586:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587309.613652:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310036096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587309.613667:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788587309.613687:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587309.613723:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310036096:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788587309.658151:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 105a14ca-5728-4c79-85fc-db7f7cf354e5 00000001:00100000:1.0:1788587309.658169:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a3fdddd-8216-4b58-9628-ff883535a8b8 00010000:00010000:0.0:1788587309.867398:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587310.635869:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310036352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.635935:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587310.635985:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310036864:0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.636022:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587310.637148:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310036224:0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.637292:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587310.637327:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310036736:0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.637353:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587310.637441:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310037248:0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.637464:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587310.637488:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788587310.637495:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310036608:0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.637517:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587310.637536:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310037120:0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.637554:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587310.637613:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310036224 00000100:00100000:2.0:1788587310.637619:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310036224 00000100:00100000:2.0:1788587310.637663:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788587310.637672:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310036224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.637714:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310036224:12345-0@lo:400:kworker.0 Request processed in 43us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587310.637721:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788587310.637754:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310036736 00000100:00100000:2.0:1788587310.637758:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310036736 00000100:00100000:2.0:1788587310.637787:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310037248 00000100:00100000:0.0:1788587310.637832:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310036480:0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.637864:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587310.637959:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310036992:0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.637984:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587310.638002:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310037504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587310.638025:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587310.638044:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310038016:0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.638133:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587310.638155:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587310.638161:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310037888:0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.638183:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587310.638204:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310036608 00000100:00100000:0.0:1788587310.638208:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310036608 00000100:00100000:0.0:1788587310.638244:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310037120 00000100:00100000:0.0:1788587310.638248:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310037120 00000100:00100000:0.0:1788587310.638263:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310036480 00000100:00100000:0.0:1788587310.638265:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310036480 00000100:00100000:0.0:1788587310.638289:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310036992 00000100:00100000:0.0:1788587310.638292:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310036992 00000100:00100000:0.0:1788587310.638307:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587310.638313:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310036608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.638349:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310036608:12345-0@lo:400:kworker.0 Request processed in 35us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587310.638356:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587310.638369:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587310.638375:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310037120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.638401:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310037120:12345-0@lo:400:kworker.0 Request processed in 26us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587310.638407:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587310.638426:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587310.638432:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310036480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.638466:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310036480:12345-0@lo:400:kworker.0 Request processed in 34us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587310.638539:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587310.638554:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587310.638570:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310036992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.638654:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310037376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587310.638684:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587310.638715:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310037632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587310.638742:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587310.638763:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310036992:12345-0@lo:400:kworker.0 Request processed in 192us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587310.638764:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310038144:0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.638777:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587310.638815:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310037504 00000100:00100000:0.0:1788587310.638820:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310037504 00000100:00100000:1.0:1788587310.638826:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587310.638839:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310037376 00000100:00100000:0.0:1788587310.638842:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310037376 00000100:00100000:0.0:1788587310.638851:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310037632 00000100:00100000:0.0:1788587310.638853:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310037632 00000100:00100000:0.0:1788587310.638863:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587310.638869:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310037504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587310.638953:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587310.638987:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310037504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587310.638994:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587310.639003:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587310.639012:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788587310.639019:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310037376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587310.639036:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587310.639113:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0372c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310037760:0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.639145:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310037376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587310.639148:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587310.639167:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587310.639180:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310036352 00000100:00100000:1.0:1788587310.639186:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310036352 00000100:00100000:0.0:1788587310.639186:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587310.639195:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310037632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587310.639207:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587310.639213:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310036864 00000100:00100000:1.0:1788587310.639218:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310036864 00000100:00100000:1.0:1788587310.639237:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587310.639246:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310037632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587310.639247:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310036352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.639259:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587310.639287:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310038016 00000100:00100000:0.0:1788587310.639291:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310038016 00000100:00100000:0.0:1788587310.639309:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310037888 00000100:00100000:0.0:1788587310.639311:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310037888 00000100:00100000:0.0:1788587310.639322:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310038144 00000100:00100000:0.0:1788587310.639325:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310038144 00000100:00100000:0.0:1788587310.639338:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310037760 00000100:00100000:0.0:1788587310.639341:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310037760 00000100:00100000:0.0:1788587310.639354:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587310.639360:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310036736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.639393:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310036736:12345-0@lo:400:kworker.0 Request processed in 32us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587310.639400:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587310.639414:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587310.639421:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310038016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.639454:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310038016:12345-0@lo:400:kworker.0 Request processed in 34us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587310.639533:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310036352:12345-0@lo:400:kworker.0 Request processed in 288us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587310.639540:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788587310.639554:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587310.639561:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310036864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.639590:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310036864:12345-0@lo:400:kworker.0 Request processed in 30us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587310.639596:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587310.639650:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310037632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587310.639700:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310036608:0@lo:400:kworker.0 00000100:00080000:1.0:1788587310.639702:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587310.639709:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587310.639712:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587310.639714:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587310.639808:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310037120:0@lo:400:kworker.0 00000100:00100000:3.0:1788587310.639821:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310036224:0@lo:400:kworker.0 00000100:00100000:3.0:1788587310.639832:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310036736:0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.639881:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310037248 00000100:00100000:1.0:1788587310.640160:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310036480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.640172:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310036992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.640185:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310037504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587310.640196:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310038016:0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.640243:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310036352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.640254:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310036864:0@lo:400:kworker.0 00000100:00100000:1.0:1788587310.640265:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310037376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587310.641356:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587310.641395:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788587310.641414:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310037888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587310.641494:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310037888:12345-0@lo:400:kworker.0 Request processed in 90us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587310.641516:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788587310.641538:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788587310.641545:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310038144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587310.641582:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310038144:12345-0@lo:400:kworker.0 Request processed in 38us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587310.641760:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587310.641768:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310037760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.641825:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310037760:12345-0@lo:400:kworker.0 Request processed in 58us (2678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587310.641831:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788587310.641902:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe0372df80 x1875469310037888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587310.641919:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310037888:0@lo:400:kworker.0 00000100:00100000:0.0:1788587310.641968:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310037760:0@lo:400:kworker.0 00000100:00100000:3.0:1788587310.642553:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788587310.642728:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36f2aa00 x1875469310038144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587310.642739:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310038144:0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.644051:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587310.644065:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310037248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587310.644147:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310037248:12345-0@lo:400:kworker.0 Request processed in 87us (6681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587310.644165:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788587310.644778:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0372ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310037248:0@lo:400:kworker.0 00000001:00100000:0.0:1788587310.680214:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2a3fdddd-8216-4b58-9628-ff883535a8b8 00000001:00100000:0.0:1788587310.680240:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 105a14ca-5728-4c79-85fc-db7f7cf354e5 00000001:00100000:0.0:1788587310.684258:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 105a14ca-5728-4c79-85fc-db7f7cf354e5 00000001:00100000:0.0:1788587310.684288:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a3fdddd-8216-4b58-9628-ff883535a8b8 00010000:00010000:3.0:1788587310.891313:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587311.147159:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310038400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587311.147229:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587311.147450:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310038400 00000100:00100000:1.0:1788587311.147459:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310038400 00000100:00100000:1.0:1788587311.147515:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587311.147527:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310038400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587311.147568:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587311.147620:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310038400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587311.147628:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788587311.147734:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0815aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310038272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587311.147765:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587311.147816:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310038272 00000100:00100000:0.0:1788587311.147820:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310038272 00000100:00100000:0.0:1788587311.147840:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788587311.147846:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310038272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587311.147866:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587311.147903:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310038272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587311.147927:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788587311.147973:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0815aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310038272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587311.148088:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310038400:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788587311.628677:0:19035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788587311.917991:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587312.765783:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a3fdddd-8216-4b58-9628-ff883535a8b8 00010000:00010000:3.0:1788587312.941104:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587313.963316:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587314.335365:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335403:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335425:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335446:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335479:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335501:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335519:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335538:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335563:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587314.335592:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292134272 00000100:00100000:3.0:1788587314.335601:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292134272 00000100:00100000:3.0:1788587314.335664:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292134400 00000100:00100000:3.0:1788587314.335667:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292134400 00000100:00100000:3.0:1788587314.335680:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292134912 00000100:00100000:3.0:1788587314.335683:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292134912 00000100:00100000:3.0:1788587314.335694:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292134784 00000100:00100000:3.0:1788587314.335707:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292134784 00000100:00100000:3.0:1788587314.335726:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:3.0:1788587314.335965:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2410:x1875469292134272:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336056:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2410:x1875469292134272:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 320us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336064:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:3.0:1788587314.336082:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:3.0:1788587314.336089:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2409:x1875469292134400:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336115:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2409:x1875469292134400:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336121:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:3.0:1788587314.336132:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788587314.336137:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2409:x1875469292134912:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336160:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2409:x1875469292134912:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336311:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788587314.336326:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:3.0:1788587314.336334:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2410:x1875469292134784:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336360:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2410:x1875469292134784:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336365:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:3.0:1788587314.336386:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292134144 00000100:00100000:3.0:1788587314.336390:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292134144 00000100:00100000:3.0:1788587314.336418:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:3.0:1788587314.336424:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2409:x1875469292134144:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336458:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2409:x1875469292134144:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 34us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336536:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:3.0:1788587314.336572:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292134656 00000100:00100000:3.0:1788587314.336575:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292134656 00000100:00100000:3.0:1788587314.336604:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292135168 00000100:00100000:3.0:1788587314.336608:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292135168 00000100:00100000:3.0:1788587314.336621:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292134528 00000100:00100000:3.0:1788587314.336624:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292134528 00000100:00100000:3.0:1788587314.336636:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292135040 00000100:00100000:3.0:1788587314.336639:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292135040 00000100:00100000:3.0:1788587314.336727:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:3.0:1788587314.336817:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2409:x1875469292134656:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336847:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2409:x1875469292134656:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 112us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336854:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:3.0:1788587314.336866:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:3.0:1788587314.336871:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2409:x1875469292135168:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336890:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2409:x1875469292135168:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 19us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336895:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:3.0:1788587314.336905:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:3.0:1788587314.336910:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2410:x1875469292134528:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336928:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2410:x1875469292134528:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 19us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336945:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:3.0:1788587314.336957:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:3.0:1788587314.336963:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0815aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2410:x1875469292135040:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587314.336984:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0815aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2410:x1875469292135040:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 22us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587314.336990:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00080000:3.0:1788587314.337021:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587314.337025:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587314.337028:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587314.337030:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587314.734483:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587314.734512:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310038528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587314.734582:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587314.735973:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310038528 00000100:00100000:0.0:1788587314.735996:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310038528 00000100:00100000:0.0:1788587314.736059:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587314.736069:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310038528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587314.736103:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587314.736162:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310038528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587314.736169:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788587314.737233:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587314.737456:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310038528:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788587314.775552:0:19184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4f6b3900 20000000:00000080:1.0:1788587314.775569:0:19184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbf39420c00 uarg=0000000000000000 20000000:01000000:1.0:1788587314.775604:0:19184:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788587314.775610:0:19184:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788587314.775615:0:19184:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788587314.776620:0:19185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788587314.776780:0:19184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788587314.785519:0:19184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788587314.785549:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.785568:0:19184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 23 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.785596:0:19184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 23 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.785603:0:19184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 23 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.786583:0:19184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 23 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.786595:0:19184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 12 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.786602:0:19184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.786611:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.786717:0:19184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.786733:0:19184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 12 pid: 16435 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.786747:0:19184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310038656:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587314.786884:0:19184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 12 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.786893:0:19184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 12 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.786901:0:19184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310038784:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587314.786932:0:19184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 23 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.786955:0:19184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 23 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.786964:0:19184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310038912:0@lo:104: 00000100:00100000:0.0:1788587314.787010:0:19184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587314.787042:0:19184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 23 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.787050:0:19184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 23 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.787057:0:19184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310039040:0@lo:104: 00000100:00100000:0.0:1788587314.787075:0:19184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587314.787094:0:19184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 23 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.787101:0:19184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 23 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.787109:0:19184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310039168:0@lo:104: 00000100:00100000:0.0:1788587314.787128:0:19184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587314.787142:0:19184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 23 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.787150:0:19184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 23 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.787158:0:19184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310039296:0@lo:104: 00000100:00100000:0.0:1788587314.787183:0:19184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587314.787193:0:19184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587314.787843:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310038912 00000100:00100000:1.0:1788587314.787859:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310038912 00000100:00100000:1.0:1788587314.787898:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310039040 00000100:00100000:1.0:1788587314.787901:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310039040 00000100:00100000:1.0:1788587314.787911:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310039168 00000100:00100000:1.0:1788587314.787914:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310039168 00000100:00100000:1.0:1788587314.787922:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310039296 00000100:00100000:1.0:1788587314.787923:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310039296 00000100:00100000:1.0:1788587314.787955:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587314.787964:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+6:19184:x1875469310038912:12345-0@lo:104: 00010000:00010000:1.0:1788587314.788021:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.788128:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788587314.788134:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+6:19184:x1875469310038912:12345-0@lo:104: Request processed in 172us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587314.788154:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587314.788189:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587314.788196:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+5:19184:x1875469310039040:12345-0@lo:104: 00010000:00010000:1.0:1788587314.788241:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.788302:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788587314.788322:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+5:19184:x1875469310039040:12345-0@lo:104: Request processed in 127us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587314.788328:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587314.788358:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587314.788365:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:19184:x1875469310039168:12345-0@lo:104: 00010000:00010000:1.0:1788587314.788372:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.788413:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788587314.788418:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+4:19184:x1875469310039168:12345-0@lo:104: Request processed in 55us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587314.788425:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587314.788437:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587314.788444:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:19184:x1875469310039296:12345-0@lo:104: 00010000:00010000:1.0:1788587314.788451:0:16426:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.788692:0:16426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788587314.788710:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+3:19184:x1875469310039296:12345-0@lo:104: Request processed in 267us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587314.788716:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788587314.788819:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788587314.788826:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.788849:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587314.788853:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.788861:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587314.788880:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587314.788886:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587314.788930:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.788950:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587314.789013:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789022:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3e00/0x419e1ae1f6344cb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344cba expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789050:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587314.789053:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789059:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587314.789062:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789081:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587314.789087:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587314.789103:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587314.789120:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789138:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587314.789144:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789149:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3400/0x419e1ae1f6344b5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b63 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789181:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587314.789184:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789202:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f600 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587314.789439:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789449:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587314.789455:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587314.789484:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587314.789513:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789520:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587314.789551:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789558:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6344b1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b24 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789570:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587314.789583:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789614:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062ae200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587314.789617:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789623:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587314.789629:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587314.789649:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587314.789674:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789681:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587314.789688:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789708:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe062ae200/0x419e1ae1f6344b0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6344b16 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.789722:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587314.789724:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587314.789725:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587314.789756:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310039424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587314.789825:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587314.789866:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587314.789873:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310039552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587314.789904:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587314.789950:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310039680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587314.790006:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587314.790039:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587314.790044:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310039808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587314.790073:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587314.790127:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310039424 00000100:00100000:2.0:1788587314.790133:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310039424 00010000:00010000:2.0:1788587314.790184:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 24 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587314.790221:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310039552 00000100:00100000:2.0:1788587314.790225:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310039552 00010000:00010000:2.0:1788587314.790259:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 25 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587314.790271:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310039680 00000100:00100000:2.0:1788587314.790290:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310039680 00010000:00010000:2.0:1788587314.790301:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 26 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587314.790323:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310039808 00000100:00100000:2.0:1788587314.790325:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310039808 00010000:00010000:2.0:1788587314.790357:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 27 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587314.790385:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587314.790393:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+27:3472:x1875469310039424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587314.790404:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587314.790414:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 27 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.790424:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 27 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.790440:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587314.790474:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+27:3472:x1875469310039424:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587314.790481:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587314.790495:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587314.790501:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+26:3472:x1875469310039552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587314.790511:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587314.790515:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 26 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.790523:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 26 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.790531:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587314.790552:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+26:3472:x1875469310039552:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587314.790558:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587314.790570:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587314.790604:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+25:3474:x1875469310039680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587314.790633:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587314.790660:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 25 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.790678:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 25 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.790688:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587314.790716:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+25:3474:x1875469310039680:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587314.790722:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587314.790735:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587314.790740:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3474:x1875469310039808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587314.790748:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587314.790753:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 24 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.790760:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 24 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.790769:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587314.790788:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3474:x1875469310039808:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587314.790834:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587314.790888:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310039808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587314.790916:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310039680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587314.790969:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310039552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587314.790977:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310039424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587314.791562:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587314.791595:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27e00/0x419e1ae1f6344cba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344cb3 expref: 23 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.791608:0:19184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310038912:0@lo:104: 00010000:00010000:0.0:1788587314.791619:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f6344b63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344b5c expref: 22 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.791626:0:19184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310039040:0@lo:104: 00010000:00010000:0.0:1788587314.791636:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe062ae800/0x419e1ae1f6344b24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344b1d expref: 21 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.791643:0:19184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310039168:0@lo:104: 00010000:00010000:0.0:1788587314.791653:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe062ae400/0x419e1ae1f6344b16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6344b0f expref: 20 pid: 16437 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.791661:0:19184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310039296:0@lo:104: 00000100:00100000:1.0:1788587314.792594:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587314.792993:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587314.793099:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292135424 00000100:00100000:2.0:1788587314.793146:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292135424 00010000:00010000:2.0:1788587314.793192:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 13 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587314.793273:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292135296 00000100:00100000:2.0:1788587314.793277:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292135296 00010000:00010000:2.0:1788587314.793304:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 14 pid: 16435 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587314.793341:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:2.0:1788587314.793365:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe040bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+14:2409:x1875469292135424:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587314.793378:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587314.793383:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 14 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.793393:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 14 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.793411:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587314.793910:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:1.0:1788587314.793934:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+14:2409:x1875469292135296:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587314.793956:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587314.793963:0:16428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 14 pid: 16435 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.793974:0:16428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 14 pid: 16435 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.793997:0:16428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794034:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794061:0:16428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794069:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794086:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794094:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794100:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587314.794115:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794125:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794145:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587314.794156:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587314.794206:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+14:2409:x1875469292135296:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 288us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587314.794234:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:2.0:1788587314.794470:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe040bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2409:x1875469292135424:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 110us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587314.794480:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00010000:00010000:0.0:1788587314.794688:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344e50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c58 expref: 12 pid: 16435 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.794703:0:19184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310038656:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587314.794715:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27000/0x419e1ae1f6344e11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be8 expref: 11 pid: 16436 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587314.794724:0:19184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19184:1875469310038784:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587314.794757:0:19184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.794816:0:19184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.794823:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587314.794829:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483600/0x419e1ae1f6344e81 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587314.987072:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587315.756168:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310040064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587315.756262:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.756301:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587315.756306:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310039936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587315.756330:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.756360:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310040064 00000100:00100000:2.0:1788587315.756377:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310040064 00000100:00100000:2.0:1788587315.756426:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310039936 00000100:00100000:2.0:1788587315.756430:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310039936 00000100:00100000:2.0:1788587315.756453:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587315.756462:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310040064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587315.756494:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587315.756543:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310040064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.756551:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587315.756568:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587315.756576:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310039936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587315.756587:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587315.756614:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310039936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.756619:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788587315.756641:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587315.756880:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310040192:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.756914:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.756952:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310040704:0@lo:400:kworker.0 00000100:00100000:0.0:1788587315.756952:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310040192 00000100:00100000:0.0:1788587315.756959:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310040192 00000100:00100000:0.0:1788587315.756995:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788587315.757003:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:3474:x1875469310040192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587315.757039:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:3474:x1875469310040192:12345-0@lo:400:kworker.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587315.757046:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788587315.757178:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.757206:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310041216:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757233:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.757280:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310040192:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757295:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788587315.757301:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310040320:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757325:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.757352:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310040832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757377:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.757395:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469310041344:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757418:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.757448:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310040704 00000100:00100000:2.0:1788587315.757452:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310040704 00000100:00100000:2.0:1788587315.757472:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310040320 00000100:00100000:2.0:1788587315.757475:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310040320 00000100:00100000:2.0:1788587315.757488:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587315.757494:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310040704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757533:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310040704:12345-0@lo:400:kworker.0 Request processed in 39us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.757539:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587315.757550:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587315.757556:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310040320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757578:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310040320:12345-0@lo:400:kworker.0 Request processed in 23us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.757583:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587315.757601:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310040832 00000100:00100000:2.0:1788587315.757604:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310040832 00000100:00100000:2.0:1788587315.757636:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587315.757641:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310040832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757670:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310040832:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.757676:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587315.757691:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310041216 00000100:00100000:2.0:1788587315.757694:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310041216 00000100:00100000:2.0:1788587315.757726:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310041344 00000100:00100000:2.0:1788587315.757729:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310041344 00000100:00100000:2.0:1788587315.757747:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587315.757752:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310041216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757779:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310041216:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.757784:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587315.757820:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587315.757826:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469310041344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757865:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469310041344:12345-0@lo:400:kworker.0 Request processed in 39us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.757872:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788587315.757888:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587315.757891:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587315.757894:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587315.757907:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310040576:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757932:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.757951:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469310041088:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.757972:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.758015:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310039936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587315.758030:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310040064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587315.758047:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788587315.758053:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310040448:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758076:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.758096:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310040960:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758129:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.758141:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310041472:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758160:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587315.758178:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310040576 00000100:00100000:2.0:1788587315.758182:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310040576 00000100:00100000:2.0:1788587315.758199:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310041088 00000100:00100000:2.0:1788587315.758202:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310041088 00000100:00100000:2.0:1788587315.758219:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310040960 00000100:00100000:2.0:1788587315.758222:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310040960 00000100:00100000:2.0:1788587315.758232:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310041472 00000100:00100000:2.0:1788587315.758234:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310041472 00000100:00100000:2.0:1788587315.758262:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587315.758267:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310040576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758304:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310040576:12345-0@lo:400:kworker.0 Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.758311:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587315.758324:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587315.758331:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469310041088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758358:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469310041088:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.758364:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587315.758374:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587315.758379:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310040960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758401:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310040960:12345-0@lo:400:kworker.0 Request processed in 22us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.758406:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587315.758415:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587315.758427:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469310041472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758451:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469310041472:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.758457:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788587315.758470:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587315.758473:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587315.758490:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310040320:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758499:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310040832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758508:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469310041344:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758518:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310040704:0@lo:400:kworker.0 00010000:00080000:2.0:1788587315.758529:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34197800 x1875469310041216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587315.758539:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310041216:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758567:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310040960:0@lo:400:kworker.0 00010000:00080000:2.0:1788587315.758575:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf34196a00 x1875469310041472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587315.758583:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310041472:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758592:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310040576:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.758600:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469310041088:0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.759142:0:18542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310040448 00000100:00100000:2.0:1788587315.759150:0:18542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310040448 00000100:00100000:2.0:1788587315.759189:0:18542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587315.759204:0:18542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310040448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587315.759710:0:18542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310040448:12345-0@lo:400:kworker.0 Request processed in 504us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587315.759718:0:18542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587315.760013:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587315.760026:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310041600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587315.760073:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587315.760112:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310041600 00000100:00100000:3.0:1788587315.760116:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310041600 00000100:00100000:3.0:1788587315.760151:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587315.760160:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310041600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587315.760177:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587315.760217:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310041600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587315.760224:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587315.760280:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310041600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587315.760440:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310040448:0@lo:400:kworker.0 00000100:00100000:0.0:1788587315.986436:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587315.987658:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292135552 00000100:00100000:3.0:1788587315.987671:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292135552 00000100:00100000:3.0:1788587315.987734:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:3.0:1788587315.987745:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:15063:x1875469292135552:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587315.987768:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587315.987787:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f6344e88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5c90 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587315.987838:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f6344e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c90 expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587315.987851:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f6344e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c90 expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587315.987859:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3600, rc 0) 00000100:00100000:3.0:1788587315.987923:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15063:x1875469292135552:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 180us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587315.987930:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:1.0:1788587316.002555:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587316.005186:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292135680 00000100:00100000:3.0:1788587316.005199:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292135680 00000100:00100000:3.0:1788587316.005262:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00100000:3.0:1788587316.005273:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15063:x1875469292135680:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587316.005549:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15063:x1875469292135680:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 277us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587316.005557:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00100000:3.0:1788587316.008648:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587316.008732:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292135808 00000100:00100000:2.0:1788587316.008741:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292135808 00000100:00100000:2.0:1788587316.008810:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:2.0:1788587316.008821:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15063:x1875469292135808:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.009037:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15063:x1875469292135808:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 217us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587316.009045:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 146 00010000:00010000:3.0:1788587316.013283:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587316.025221:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587316.025409:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292135936 00000100:00100000:1.0:1788587316.025420:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292135936 00000100:00100000:1.0:1788587316.025470:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 147 00000100:00100000:1.0:1788587316.025480:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:15063:x1875469292135936:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587316.025497:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587316.025514:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6344e8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5c97 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.025544:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6344e8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c97 expref: 13 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.025555:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6344e8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c97 expref: 13 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.025565:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482600, rc 0) 00000100:00100000:1.0:1788587316.025618:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15063:x1875469292135936:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 139us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587316.025625:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 147 00000100:00100000:2.0:1788587316.029341:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587316.034254:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292136064 00000100:00100000:1.0:1788587316.034267:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292136064 00000100:00100000:1.0:1788587316.034311:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 148 00000100:00100000:1.0:1788587316.034319:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15063:x1875469292136064:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.034575:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15063:x1875469292136064:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 255us (5242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587316.034583:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 148 00000100:00100000:3.0:1788587316.039372:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587316.040289:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292136192 00000100:00100000:1.0:1788587316.040301:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292136192 00000100:00100000:1.0:1788587316.040361:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 149 00000100:00100000:1.0:1788587316.040372:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15063:x1875469292136192:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.040613:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:15063:x1875469292136192:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 242us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587316.040622:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 149 00000100:00100000:0.0:1788587316.268732:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310041728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587316.268821:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587316.268875:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310041728 00000100:00100000:0.0:1788587316.268882:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310041728 00000100:00100000:0.0:1788587316.268926:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788587316.269156:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310041728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587316.269198:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587316.270673:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310041728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1731us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587316.270689:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587316.272131:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310041728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587316.274868:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587316.274887:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310041856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587316.274968:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587316.275501:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310041856 00000100:00100000:1.0:1788587316.275510:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310041856 00000100:00100000:1.0:1788587316.275550:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587316.275560:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310041856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587316.275600:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587316.275668:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310041856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587316.275677:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788587316.280566:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310041856:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788587316.396444:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788587316.714845:0:16439:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587316.714852:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe0587a000 from 13 10000000:01000000:1.0:1788587316.714857:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587316.714898:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.714909:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.714922:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587316.714945:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310041984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.715008:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587316.715055:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587316.715088:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310041984 00000100:00100000:1.0:1788587316.715096:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310041984 00000100:00100000:1.0:1788587316.715218:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788587316.715228:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:16439:x1875469310041984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587316.715254:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587316.715268:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6344e9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344e96 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.715292:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6344e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344e96 expref: 21 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.715303:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6344e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344e96 expref: 21 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.715312:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482200, rc 0) 00000100:00100000:1.0:1788587316.715563:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310041984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 336us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587316.715571:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788587316.715620:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310041984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587316.715635:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.715645:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587316.715698:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.715726:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587316.715752:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587316.715767:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310042112 00000100:00100000:1.0:1788587316.715771:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310042112 00000100:00100000:1.0:1788587316.715968:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788587316.715977:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310042112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.716467:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310042112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 490us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587316.716476:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788587316.716522:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.716558:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.716599:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587316.716625:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587316.716639:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310042240 00000100:00100000:1.0:1788587316.716644:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310042240 00000100:00100000:1.0:1788587316.716999:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788587316.717010:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310042240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.717277:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310042240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587316.717285:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788587316.717488:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788587316.722345:0:19296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788587316.722447:0:16439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788587316.722468:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587316.722480:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.722491:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587316.722508:0:16439:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587316.722510:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf1095e800 from 13 10000000:01000000:1.0:1788587316.722513:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587316.722553:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.722560:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.722572:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587316.722599:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587316.722664:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587316.722709:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587316.723533:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310042368 00000100:00100000:0.0:1788587316.723543:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310042368 00000100:00100000:0.0:1788587316.723594:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788587316.723604:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:16439:x1875469310042368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587316.723618:0:16435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587316.723633:0:16435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499e400/0x419e1ae1f6344eab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344ea4 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587316.723656:0:16435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499e400/0x419e1ae1f6344eab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344ea4 expref: 22 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587316.723668:0:16435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499e400/0x419e1ae1f6344eab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344ea4 expref: 22 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587316.724255:0:16435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e400, rc 0) 00000100:00100000:0.0:1788587316.724325:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:16439:x1875469310042368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 722us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587316.724333:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788587316.724387:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587316.724406:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587316.724417:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587316.724486:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587316.724515:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587316.724543:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587316.724558:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310042496 00000100:00100000:0.0:1788587316.724562:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310042496 00000100:00100000:0.0:1788587316.724594:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788587316.724601:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:16439:x1875469310042496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587316.725268:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:16439:x1875469310042496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 614us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587316.725276:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788587316.725307:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.725338:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.735208:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587316.735261:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf034a90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587316.735286:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310042624 00000100:00100000:2.0:1788587316.735295:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310042624 00000100:00100000:2.0:1788587316.735345:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788587316.735355:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:16439:x1875469310042624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.735567:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:16439:x1875469310042624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587316.735584:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788587316.735645:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587316.736388:0:19297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788587316.736447:0:16439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788587316.736465:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587316.736476:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.736486:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587316.736496:0:16439:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587316.736499:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe05dae000 from 13 10000000:01000000:2.0:1788587316.736501:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587316.736533:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.736540:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.736548:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587316.736568:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.736610:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587316.736644:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf034a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587316.736847:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310042752 00000100:00100000:0.0:1788587316.736853:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310042752 00000100:00100000:0.0:1788587316.736889:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587316.736896:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:16439:x1875469310042752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587316.736906:0:16436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587316.736918:0:16436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6344eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344eb2 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587316.736938:0:16436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6344eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344eb2 expref: 23 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587316.736949:0:16436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6344eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344eb2 expref: 23 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587316.736957:0:16436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f000, rc 0) 00000100:00100000:0.0:1788587316.736991:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310042752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587316.737006:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587316.737160:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587316.737175:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587316.737185:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587316.737255:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36f28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587316.737281:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587316.737334:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587316.737438:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310042880 00000100:00100000:2.0:1788587316.737442:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310042880 00000100:00100000:2.0:1788587316.737501:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788587316.737509:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310042880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.737729:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310042880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587316.737737:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788587316.737869:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36f28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310042880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.737900:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310043008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.737939:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587316.737994:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf20affd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587316.738023:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310043008 00000100:00100000:0.0:1788587316.738027:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310043008 00000100:00100000:0.0:1788587316.738149:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788587316.738157:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310043008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587316.738431:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310043008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587316.738438:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788587316.738440:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310043008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788587316.739559:0:19298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788587316.739712:0:16439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788587316.739732:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587316.739741:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.739752:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587316.739762:0:16439:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587316.739764:0:16439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe04f8d000 from 13 10000000:01000000:2.0:1788587316.739767:0:16439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587316.739952:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.739961:0:16439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.739971:0:16439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587316.740068:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310043136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587316.740123:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587316.740188:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf036346c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587316.740321:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310043136 00000100:00100000:2.0:1788587316.740329:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310043136 00000100:00100000:2.0:1788587316.740386:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788587316.740395:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:16439:x1875469310043136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587316.740407:0:16437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587316.740420:0:16437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344ec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6344ec0 expref: -99 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.740442:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6344ec0 expref: 24 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.740453:0:16437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6344ec0 expref: 24 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587316.740462:0:16437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044600, rc 0) 00000100:00100000:2.0:1788587316.740498:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:16439:x1875469310043136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587316.740503:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587316.740516:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310043136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587316.740530:0:16439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587316.740539:0:16439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587316.740590:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310043264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587316.740617:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587316.740669:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf036346c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587316.740699:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310043264 00000100:00100000:0.0:1788587316.740704:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310043264 00000100:00100000:0.0:1788587316.740739:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788587316.740747:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:16439:x1875469310043264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587316.741183:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:16439:x1875469310043264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 436us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587316.741192:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788587316.741309:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310043264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587316.741342:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310043392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587316.741380:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587316.741410:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf036346c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587316.741560:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310043392 00000100:00100000:2.0:1788587316.741565:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310043392 00000100:00100000:2.0:1788587316.741628:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788587316.741636:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:16439:x1875469310043392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587316.741820:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:16439:x1875469310043392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587316.741828:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788587316.741968:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:16439:1875469310043392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788587316.742832:0:19299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788587316.743143:0:16439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788587316.743166:0:16439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587316.743175:0:16439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587316.743186:0:16439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.034967:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587317.163623:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587317.920996:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587317.921110:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292136320 00000100:00100000:2.0:1788587317.921134:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292136320 00000100:00100000:2.0:1788587317.921212:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788587317.921238:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:15727:x1875469292136320:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587317.921405:0:17774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587317.921425:0:17774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6344ece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5c9e expref: -99 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.921624:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.921639:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.921657:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.921672:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.921678:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.921685:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922011:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18a00/0x419e1ae1f6344ee3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922022:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18a00/0x419e1ae1f6344ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922030:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18a00/0x419e1ae1f6344ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587317.922059:0:17774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587317.922062:0:17774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587317.922098:0:17774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18a00/0x419e1ae1f6344ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922109:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922115:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922121:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922126:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587317.922130:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922138:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922149:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587317.922152:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587317.922158:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922164:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922177:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922194:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922199:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922203:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587317.922206:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922233:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922242:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cbf20ad1a00) 00010000:00010000:2.0:1788587317.922245:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587317.922248:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.922254:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344edc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587317.922403:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587317.923100:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044a00/0x419e1ae1f6344ece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c9e expref: 8 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.923410:0:17774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18a00/0x419e1ae1f6344ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c9e expref: 7 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.923419:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf20ad1f00) 00010000:00010000:2.0:1788587317.923422:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587317.923434:0:17774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c18a00, rc 0) 00000100:00100000:2.0:1788587317.923727:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:15727:x1875469292136320:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 2491us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587317.923735:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:1.0:1788587317.927031:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587317.927117:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292136448 00000100:00100000:3.0:1788587317.927128:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292136448 00000100:00100000:3.0:1788587317.927183:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:3.0:1788587317.927193:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:15727:x1875469292136448:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788587317.927322:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:15727:x1875469292136448:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 Request processed in 130us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587317.927330:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:3.0:1788587317.931173:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587317.934625:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292136704 00000100:00100000:2.0:1788587317.934641:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292136704 00000100:00100000:2.0:1788587317.934843:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788587317.934856:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:15727:x1875469292136704:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587317.934877:0:16442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587317.934899:0:16442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344eea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ca5 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.934970:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.934985:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.934998:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.935062:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.935070:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.935076:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.935421:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18c00/0x419e1ae1f6344eff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.935437:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18c00/0x419e1ae1f6344eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.935963:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18c00/0x419e1ae1f6344eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587317.935975:0:16442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788587317.936189:0:16442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936197:0:16442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936203:0:16442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936209:0:16442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587317.936213:0:16442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936239:0:16442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936252:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf20ad1f00) 00010000:00010000:2.0:1788587317.936255:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587317.936259:0:16442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936266:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ef1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936278:0:16442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936291:0:16442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936297:0:16442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936302:0:16442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587317.936305:0:16442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936317:0:16442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936325:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cbf20ad1a00) 00010000:00010000:2.0:1788587317.936327:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587317.936330:0:16442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.936335:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344ef8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.938704:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344eea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ca5 expref: 10 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.938738:0:16442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18c00/0x419e1ae1f6344eff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ca5 expref: 9 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.938747:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf20ad1900) 00010000:00010000:2.0:1788587317.938750:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587317.938762:0:16442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c18c00, rc 0) 00000100:00100000:2.0:1788587317.938862:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:15727:x1875469292136704:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 4008us (7697us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788587317.938871:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788587317.944523:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587317.946046:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292136832 00000100:00100000:3.0:1788587317.946063:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292136832 00000100:00100000:3.0:1788587317.946241:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788587317.946253:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:15727:x1875469292136832:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788587317.946529:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:15727:x1875469292136832:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 277us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587317.946538:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788587317.959313:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587317.959677:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292136960 00000100:00100000:1.0:1788587317.959688:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292136960 00000100:00100000:1.0:1788587317.959761:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:1.0:1788587317.959773:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:15727:x1875469292136960:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788587317.961987:0:16444:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2115us 00000100:00080000:0.0:1788587317.962537:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587317.981896:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:15727:x1875469292136960:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 22117us (22585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587317.981909:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:0.0:1788587317.995848:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587317.995983:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292137088 00000100:00100000:2.0:1788587317.995994:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292137088 00000100:00100000:2.0:1788587317.996055:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:2.0:1788587317.996065:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:15733:x1875469292137088:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587317.996085:0:17774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587317.996108:0:17774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cac expref: -99 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996175:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996189:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996200:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996272:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996281:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996287:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996514:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996523:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996530:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996537:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587317.996541:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996549:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996560:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587317.996563:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587317.996568:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996574:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996587:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996593:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996598:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996610:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587317.996614:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996620:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996628:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbf20ad1a00) 00010000:00010000:2.0:1788587317.996630:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587317.996633:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996639:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996673:0:17774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cac expref: 10 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996690:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587317.996693:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587317.996696:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cac expref: 10 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587317.996706:0:17774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c18000, rc 0) 00000100:00100000:2.0:1788587317.996768:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:15733:x1875469292137088:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 704us (986us total) trans 0 rc 301/301 00000100:00100000:2.0:1788587317.996776:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788587318.006379:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.006452:0:16451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292137216 00000100:00100000:2.0:1788587318.006474:0:16451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292137216 00000100:00100000:2.0:1788587318.006528:0:16451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:2.0:1788587318.006539:0:16451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:15733:x1875469292137216:12345-192.168.203.14@tcp:700:lfs.0 00000100:00100000:2.0:1788587318.006665:0:16451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:15733:x1875469292137216:12345-192.168.203.14@tcp:700:lfs.0 Request processed in 125us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.006673:0:16451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788587318.009268:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.009399:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292137472 00000100:00100000:2.0:1788587318.009420:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292137472 00000100:00100000:2.0:1788587318.009484:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:2.0:1788587318.009495:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:15733:x1875469292137472:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:2.0:1788587318.009564:0:16442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587318.009592:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6344e3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c19 expref: 9 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.009614:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:2.0:1788587318.009620:0:16442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587318.009870:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.009886:0:16442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 5 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.009894:0:16442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.009926:0:16442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 5 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.009950:0:16442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 5 pid: 17774 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587318.009965:0:16442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16442:1875469310043520:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587318.010052:0:16442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587318.012613:0:16442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16442:1875469310043520:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587318.012646:0:16442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587318.013118:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.013188:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292137600 00000100:00100000:1.0:1788587318.013196:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292137600 00010000:00010000:1.0:1788587318.013264:0:16428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 6 pid: 17774 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587318.013300:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:1.0:1788587318.013323:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2409:x1875469292137600:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587318.013341:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587318.013349:0:16428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 6 pid: 17774 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.013362:0:16428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 6 pid: 17774 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.013388:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6344e7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c89 expref: 6 pid: 17774 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.013407:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:1.0:1788587318.013412:0:16428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.013422:0:16428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.013431:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.013480:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587318.013533:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2409:x1875469292137600:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 223us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587318.013541:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00080000:0.0:1788587318.014134:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587318.014199:0:16442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.014208:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.014242:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.014253:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.014263:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016556:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016577:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016589:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587318.016604:0:16442:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e10699c1 reply state 00000000d774c591 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016615:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016624:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:3.0:1788587318.016628:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587318.016632:0:16442:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788587318.016639:0:16442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788587318.016648:0:16442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016654:0:16442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016662:0:16442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016668:0:16442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587318.016673:0:16442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016693:0:16442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016705:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be900) 00010000:00010000:3.0:1788587318.016707:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587318.016720:0:16442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016727:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18000/0x419e1ae1f6344f22 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587318.016746:0:16442:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e10699c1 reply state 00000000d774c591 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016755:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.016762:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbf02c76000) 00010000:00010000:3.0:1788587318.016764:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587318.016766:0:16442:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788587318.016898:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+10:15733:x1875469292137472:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 7400us (7635us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788587318.016906:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00010000:00010000:3.0:1788587318.061621:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587318.101561:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.102561:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292137728 00000100:00100000:2.0:1788587318.102573:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292137728 00000100:00100000:2.0:1788587318.102891:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:2.0:1788587318.102903:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+10:15741:x1875469292137728:12345-192.168.203.14@tcp:101:lctl.0 00010000:00010000:2.0:1788587318.102930:0:16443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587318.102962:0:16443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cb3 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.103045:0:16443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.103059:0:16443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.103072:0:16443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587318.103104:0:16443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587318.103121:0:16443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587318.103160:0:16443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.103184:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cb3 expref: 12 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.103202:0:16443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cb3 expref: 11 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.103212:0:16443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:2.0:1788587318.103215:0:16443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587318.103219:0:16443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19800, rc 0) 00000100:00100000:2.0:1788587318.103283:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+11:15741:x1875469292137728:12345-192.168.203.14@tcp:101:lctl.0 Request processed in 382us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.103290:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:0.0:1788587318.128482:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.128850:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292137856 00000100:00100000:1.0:1788587318.128860:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292137856 00000100:00100000:1.0:1788587318.128922:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:1.0:1788587318.128934:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:15742:x1875469292137856:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587318.128954:0:16444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587318.128985:0:16444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cba expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.129051:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483e00/0x419e1ae1f6344f4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.129076:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483e00/0x419e1ae1f6344f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.129088:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483e00/0x419e1ae1f6344f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587318.129122:0:16444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587318.129126:0:16444:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587318.129144:0:16444:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483e00/0x419e1ae1f6344f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.129165:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cba expref: 7 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.129202:0:16444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483e00/0x419e1ae1f6344f4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cba expref: 6 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.129211:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:1.0:1788587318.129219:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587318.129233:0:16444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483e00, rc 0) 00000100:00100000:1.0:1788587318.129523:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15742:x1875469292137856:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 590us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587318.129530:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:1.0:1788587318.132624:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.132717:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292137984 00000100:00100000:0.0:1788587318.132728:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292137984 00000100:00100000:0.0:1788587318.132785:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:0.0:1788587318.132835:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:15742:x1875469292137984:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587318.132855:0:17774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587318.132876:0:17774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344f53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cc1 expref: -99 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.132948:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.132962:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.132973:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.132985:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.132992:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133015:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133115:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6344f68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133124:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6344f68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133131:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6344f68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587318.133160:0:17774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587318.133164:0:17774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587318.133186:0:17774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6344f68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133198:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133204:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133211:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133218:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587318.133231:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133241:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133261:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:0.0:1788587318.133264:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587318.133269:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133275:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6344f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133299:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133305:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133310:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133314:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587318.133317:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133322:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133328:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbf02c76000) 00010000:00010000:0.0:1788587318.133330:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587318.133333:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133338:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344f61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133374:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cc1 expref: 8 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133387:0:17774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6344f68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cc1 expref: 7 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.133394:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:0.0:1788587318.133396:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587318.133399:0:17774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e600, rc 0) 00000100:00100000:0.0:1788587318.133466:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+7:15742:x1875469292137984:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 672us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587318.133474:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:3.0:1788587318.138043:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.138121:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292138112 00000100:00100000:2.0:1788587318.138132:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292138112 00000100:00100000:2.0:1788587318.138209:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00080000:0.0:1788587318.138219:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587318.138229:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0372e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:15742:x1875469292138112:12345-192.168.203.14@tcp:900:lfs.0 00000100:00100000:2.0:1788587318.138317:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0372e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:15742:x1875469292138112:12345-192.168.203.14@tcp:900:lfs.0 Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.138325:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:3.0:1788587318.142464:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.142548:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292138368 00000100:00100000:2.0:1788587318.142556:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292138368 00000100:00100000:2.0:1788587318.142710:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:2.0:1788587318.142721:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+7:15742:x1875469292138368:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587318.142741:0:16442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587318.142774:0:16442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cc8 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587318.142909:0:16442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587318.143036:0:16442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cc8 expref: 9 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.143052:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:2.0:1788587318.143054:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587318.143059:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cc8 expref: 9 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.143076:0:16442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19400, rc 0) 00000100:00100000:2.0:1788587318.143145:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+8:15742:x1875469292138368:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 423us (687us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788587318.143152:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:0.0:1788587318.147667:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.147745:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292138624 00000100:00100000:2.0:1788587318.147756:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292138624 00000100:00100000:2.0:1788587318.147868:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:2.0:1788587318.147888:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+8:15742:x1875469292138624:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:2.0:1788587318.147942:0:16443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587318.147968:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6344f68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cc1 expref: 8 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.147989:0:16443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:2.0:1788587318.147994:0:16443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587318.148016:0:16443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.148048:0:16443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.148058:0:16443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587318.148265:0:16443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004939f023 reply state 000000005d701d5f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.148278:0:16443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.148285:0:16443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:2.0:1788587318.148288:0:16443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788587318.148291:0:16443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788587318.148298:0:16443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788587318.148375:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+9:15742:x1875469292138624:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 488us (717us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788587318.148382:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:3.0:1788587318.153950:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.154086:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292138880 00000100:00100000:0.0:1788587318.154095:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292138880 00000100:00100000:0.0:1788587318.154178:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:0.0:1788587318.154188:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+9:15742:x1875469292138880:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788587318.154431:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+10:15742:x1875469292138880:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 243us (488us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788587318.154439:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788587318.158581:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.159415:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292139136 00000100:00100000:1.0:1788587318.159427:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292139136 00000100:00100000:1.0:1788587318.160160:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:1.0:1788587318.161371:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+10:15742:x1875469292139136:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587318.161399:0:16444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587318.161421:0:16444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6344f84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ccf expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.161769:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.161781:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.161790:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.161830:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.161836:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.161840:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587318.161982:0:16444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587318.162087:0:16444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162096:0:16444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162172:0:16444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162179:0:16444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587318.162183:0:16444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162191:0:16444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162203:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:1.0:1788587318.162207:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587318.162211:0:16444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162239:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162251:0:16444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162258:0:16444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162264:0:16444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162269:0:16444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587318.162272:0:16444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162278:0:16444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162286:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbf02c76000) 00010000:00010000:1.0:1788587318.162288:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587318.162291:0:16444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162297:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483800/0x419e1ae1f6344f92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162329:0:16444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6344f84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ccf expref: 12 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162351:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:1.0:1788587318.162354:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587318.162359:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483c00/0x419e1ae1f6344f84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ccf expref: 12 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.162369:0:16444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483c00, rc 0) 00000100:00100000:1.0:1788587318.162570:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+11:15742:x1875469292139136:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1215us (4000us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788587318.162579:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:1.0:1788587318.166867:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.167075:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292139264 00000100:00100000:0.0:1788587318.167086:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292139264 00000100:00100000:0.0:1788587318.167158:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:0.0:1788587318.167169:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+11:15742:x1875469292139264:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587318.167206:0:17774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587318.167238:0:17774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344fa0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cd6 expref: -99 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.167349:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.167364:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.167377:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587318.167401:0:17774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587318.167405:0:17774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587318.167424:0:17774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.167454:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344fa0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 13 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.167474:0:17774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 12 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.167481:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:0.0:1788587318.167484:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587318.167488:0:17774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fa00, rc 0) 00000100:00100000:0.0:1788587318.167549:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+12:15742:x1875469292139264:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 382us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587318.167567:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:3.0:1788587318.174350:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.174674:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292139392 00000100:00100000:2.0:1788587318.174684:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292139392 00000100:00100000:2.0:1788587318.174745:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:2.0:1788587318.174759:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+12:15742:x1875469292139392:12345-192.168.203.14@tcp:37:lfs.0 00000100:00100000:2.0:1788587318.180249:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+12:15742:x1875469292139392:12345-192.168.203.14@tcp:37:lfs.0 Request processed in 5483us (5898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.180264:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587318.184736:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.184935:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292139648 00000100:00100000:0.0:1788587318.184946:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292139648 00000100:00100000:0.0:1788587318.185008:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788587318.185019:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41b0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+12:15742:x1875469292139648:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788587318.185318:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41b0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+13:15742:x1875469292139648:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 300us (589us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788587318.185326:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000040:00080000:0.0:1788587318.187401:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788587318.248480:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.248645:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292139776 00000100:00100000:2.0:1788587318.248655:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292139776 00000100:00100000:2.0:1788587318.248745:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:2.0:1788587318.248756:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+11:15748:x1875469292139776:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788587318.248778:0:16442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587318.248832:0:16442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344fae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cdd expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.248895:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.248909:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.248920:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.248930:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.248936:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.248943:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249154:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6344fc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249163:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6344fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249170:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6344fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587318.249207:0:16442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587318.249211:0:16442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587318.249254:0:16442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6344fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249266:0:16442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249273:0:16442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249280:0:16442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249286:0:16442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587318.249290:0:16442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249297:0:16442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249308:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:2.0:1788587318.249312:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587318.249316:0:16442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249324:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6344fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249337:0:16442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249352:0:16442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249358:0:16442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249362:0:16442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587318.249365:0:16442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249372:0:16442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249380:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbf02c76000) 00010000:00010000:2.0:1788587318.249383:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587318.249385:0:16442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249391:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6344fbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249418:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cdd expref: 13 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249431:0:16442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6344fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cdd expref: 12 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.249438:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:2.0:1788587318.249440:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788587318.249449:0:16442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19a00, rc 0) 00000100:00100000:2.0:1788587318.249514:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+12:15748:x1875469292139776:12345-192.168.203.14@tcp:101:bash.0 Request processed in 760us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.249521:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:3.0:1788587318.256640:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.256928:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292139904 00000100:00100000:2.0:1788587318.256939:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292139904 00000100:00100000:2.0:1788587318.257052:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788587318.257063:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:15748:x1875469292139904:12345-192.168.203.14@tcp:900:bash.0 00000100:00100000:2.0:1788587318.257147:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:15748:x1875469292139904:12345-192.168.203.14@tcp:900:bash.0 Request processed in 86us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.257155:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788587318.260608:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.260676:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292140160 00000100:00100000:0.0:1788587318.260686:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292140160 00000100:00100000:0.0:1788587318.260745:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:0.0:1788587318.260757:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+12:15748:x1875469292140160:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587318.260776:0:17774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587318.260831:0:17774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344fca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ce4 expref: -99 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.261183:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.261392:0:17774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 12 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.261401:0:17774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.261455:0:17774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 12 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.261469:0:17774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 12 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587318.261506:0:17774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17774:1875469310043648:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587318.261662:0:17774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587318.268042:0:17774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17774:1875469310043648:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587318.268074:0:17774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587318.268085:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.268162:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292140288 00000100:00100000:2.0:1788587318.268170:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292140288 00010000:00010000:2.0:1788587318.268206:0:16429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 13 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587318.268259:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:2.0:1788587318.268269:0:16429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+13:2409:x1875469292140288:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587318.268285:0:16429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587318.268292:0:16429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 13 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.268304:0:16429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 13 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.268327:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6344fa7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cd6 expref: 13 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.268362:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:2.0:1788587318.268367:0:16429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.268376:0:16429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.268384:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.268412:0:16429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587318.268497:0:17774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.268505:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.268528:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.268539:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.268547:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587318.268609:0:16429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+12:2409:x1875469292140288:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 340us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.268617:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00010000:00010000:1.0:1788587318.270168:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270197:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270210:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587318.270243:0:17774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788587318.270845:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270856:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270863:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270869:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587318.270873:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270881:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270894:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:1.0:1788587318.270897:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587318.270901:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270906:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fd1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587318.270919:0:17774:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5b2dbbd reply state 00000000f76ccb48 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270929:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.270948:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cbf03ac7f00) 00010000:00010000:1.0:1788587318.270951:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587318.270954:0:17774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788587318.270994:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6344fca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 15 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.271011:0:17774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 14 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.271018:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:1.0:1788587318.271021:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788587318.271023:0:17774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483600, rc 0) 00000100:00100000:1.0:1788587318.271258:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+15:15748:x1875469292140160:12345-192.168.203.14@tcp:101:bash.0 Request processed in 10501us (10658us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788587318.271267:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:3.0:1788587318.292463:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.292540:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292140416 00000100:00100000:1.0:1788587318.292550:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292140416 00000100:00100000:1.0:1788587318.292662:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788587318.292673:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+15:15748:x1875469292140416:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788587318.292700:0:16444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587318.292731:0:16444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ceb expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.292825:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.292841:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.292870:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587318.292909:0:16444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788587318.292914:0:16444:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587318.292933:0:16444:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.292943:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.292968:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6344fed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 17 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.292987:0:16444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 16 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.292995:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:1.0:1788587318.292998:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587318.293002:0:16444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482e00, rc 0) 00000100:00100000:1.0:1788587318.293065:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+16:15748:x1875469292140416:12345-192.168.203.14@tcp:101:bash.0 Request processed in 394us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587318.293072:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:3.0:1788587318.296021:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.296890:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292140672 00000100:00100000:0.0:1788587318.296902:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292140672 00000100:00100000:0.0:1788587318.296960:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:0.0:1788587318.296971:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+16:15748:x1875469292140672:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:0.0:1788587318.298115:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+17:15748:x1875469292140672:12345-192.168.203.14@tcp:35:bash.0 Request processed in 1138us (2097us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788587318.298128:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:0.0:1788587318.384662:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.386363:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292140928 00000100:00100000:2.0:1788587318.386377:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292140928 00000100:00100000:2.0:1788587318.386457:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788587318.386468:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+17:15758:x1875469292140928:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587318.386491:0:16443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587318.386511:0:16443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ffb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cf2 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587318.386595:0:16443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587318.386731:0:16443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ffb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cf2 expref: 19 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.386745:0:16443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:2.0:1788587318.386760:0:16443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587318.386768:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6344ffb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cf2 expref: 19 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.386783:0:16443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19400, rc 0) 00000100:00100000:2.0:1788587318.386906:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+18:15758:x1875469292140928:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 440us (2254us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788587318.386914:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788587318.392567:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.392931:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292141184 00000100:00100000:1.0:1788587318.392942:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292141184 00000100:00100000:1.0:1788587318.393006:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788587318.393016:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+18:15758:x1875469292141184:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788587318.393676:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+19:15758:x1875469292141184:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 645us (1102us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788587318.393697:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000040:00080000:1.0:1788587318.443663:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788587318.447757:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.451325:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292141440 00000100:00100000:2.0:1788587318.451340:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292141440 00000100:00100000:2.0:1788587318.451417:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:2.0:1788587318.451426:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+19:15761:x1875469292141440:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587318.451455:0:16442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587318.451474:0:16442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6345009 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5cf9 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.451561:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6345010 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.451762:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6345010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.451775:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6345010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587318.451787:0:16442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587318.451916:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f6345009 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cf9 expref: 22 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.451950:0:16442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6345010 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cf9 expref: 21 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.451959:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:2.0:1788587318.451962:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587318.451965:0:16442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19000, rc 0) 00000100:00100000:2.0:1788587318.452251:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:15761:x1875469292141440:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 824us (4503us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788587318.452259:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:0.0:1788587318.458328:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.458382:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.458465:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292141568 00000100:00100000:2.0:1788587318.458475:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292141568 00000100:00100000:2.0:1788587318.458538:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:2.0:1788587318.458548:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:15761:x1875469292141568:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:2.0:1788587318.458623:0:16443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458640:0:16443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458652:0:16443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458688:0:16443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458696:0:16443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458719:0:16443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458726:0:16443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587318.458730:0:16443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458738:0:16443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458749:0:16443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:2.0:1788587318.458752:0:16443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587318.458756:0:16443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.458763:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634501e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587318.458858:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:15761:x1875469292141568:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 310us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.458865:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:1.0:1788587318.460709:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292141696 00000100:00100000:1.0:1788587318.460723:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292141696 00000100:00100000:1.0:1788587318.460837:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:1.0:1788587318.460849:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf08158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:2409:x1875469292141696:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587318.460863:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587318.460885:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19000/0x419e1ae1f6345010 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cf9 expref: 21 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.460903:0:16427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:1.0:1788587318.460908:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587318.460966:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf08158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+20:2409:x1875469292141696:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 119us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587318.460974:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:0.0:1788587318.462681:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.462838:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292141952 00000100:00100000:2.0:1788587318.462847:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292141952 00000100:00100000:2.0:1788587318.462895:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788587318.462906:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+20:15761:x1875469292141952:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788587318.463127:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:15761:x1875469292141952:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 223us (462us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788587318.463135:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:3.0:1788587318.728968:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.729284:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292142208 00000100:00100000:1.0:1788587318.729295:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292142208 00000100:00100000:1.0:1788587318.729359:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:1.0:1788587318.729370:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:15792:x1875469292142208:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:1.0:1788587318.729395:0:16444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587318.729416:0:16444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6345025 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d00 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.729533:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483200/0x419e1ae1f634502c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.729548:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483200/0x419e1ae1f634502c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.729575:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483200/0x419e1ae1f634502c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587318.729587:0:16444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788587318.729759:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482000/0x419e1ae1f6345025 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d00 expref: 24 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.729778:0:16444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483200/0x419e1ae1f634502c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d00 expref: 23 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.729787:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:1.0:1788587318.729789:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587318.729843:0:16444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483200, rc 0) 00000100:00100000:1.0:1788587318.729906:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+23:15792:x1875469292142208:12345-192.168.203.14@tcp:101:cat.0 Request processed in 538us (949us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788587318.729913:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:0.0:1788587318.734600:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.734693:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292142464 00000100:00100000:2.0:1788587318.734704:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292142464 00000100:00100000:2.0:1788587318.734770:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788587318.734781:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+23:15792:x1875469292142464:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:2.0:1788587318.735145:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+24:15792:x1875469292142464:12345-192.168.203.14@tcp:35:cat.0 Request processed in 364us (553us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788587318.735152:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:3.0:1788587318.742956:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.743082:0:18483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292142592 00000100:00100000:0.0:1788587318.743092:0:18483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292142592 00000100:00100000:0.0:1788587318.743164:0:18483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:0.0:1788587318.743174:0:18483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+24:2409:x1875469292142592:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587318.743188:0:18483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587318.743210:0:18483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483200/0x419e1ae1f634502c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d00 expref: 24 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.743239:0:18483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:0.0:1788587318.743243:0:18483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587318.743297:0:18483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+23:2409:x1875469292142592:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 124us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587318.743303:0:18483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:3.0:1788587318.793972:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.794088:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292142848 00000100:00100000:2.0:1788587318.794109:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292142848 00000100:00100000:2.0:1788587318.794170:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:2.0:1788587318.794180:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+23:15798:x1875469292142848:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:2.0:1788587318.794203:0:16443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587318.794235:0:16443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634503a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d07 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.794329:0:16443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.794344:0:16443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 24 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.794351:0:16443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 24 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.794359:0:16443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.794394:0:16443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 24 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.794422:0:16443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 24 pid: 16444 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587318.794447:0:16443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16443:1875469310043776:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587318.794543:0:16443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 24 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.794552:0:16443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 24 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587318.794561:0:16443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16443:1875469310043904:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587318.794585:0:16443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587318.798049:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.798112:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587318.798198:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292142976 00000100:00100000:3.0:1788587318.798207:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292142976 00010000:00010000:3.0:1788587318.798256:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 25 pid: 16444 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587318.798295:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292143104 00000100:00100000:3.0:1788587318.798298:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292143104 00010000:00010000:3.0:1788587318.798310:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 26 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587318.798333:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788587318.798344:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+26:2410:x1875469292142976:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587318.798358:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587318.798365:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 26 pid: 16444 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798379:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 26 pid: 16444 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798421:0:16427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:3.0:1788587318.798427:0:16427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798446:0:16427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798452:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587318.798499:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+26:2410:x1875469292142976:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 157us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587318.798506:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788587318.798522:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788587318.798528:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe040be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+25:2410:x1875469292143104:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587318.798534:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587318.798539:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 25 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798548:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 25 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798558:0:16427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:3.0:1788587318.798562:0:16427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798569:0:16427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798587:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.798602:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587318.798620:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe040be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+25:2410:x1875469292143104:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 92us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587318.798626:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00010000:00010000:2.0:1788587318.799379:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482e00/0x419e1ae1f6344ff4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ceb expref: 24 pid: 16444 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587318.799399:0:16443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16443:1875469310043776:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587318.799412:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6344fdf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ce4 expref: 23 pid: 17774 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587318.799422:0:16443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16443:1875469310043904:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587318.799460:0:16443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.799470:0:16443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.799486:0:16443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587318.799504:0:16443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587318.799662:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634503a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d07 expref: 24 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.799678:0:16443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d07 expref: 23 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.799685:0:16443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:2.0:1788587318.799687:0:16443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587318.799690:0:16443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19c00, rc 0) 00000100:00100000:2.0:1788587318.799781:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+23:15798:x1875469292142848:12345-192.168.203.14@tcp:101:dd.0 Request processed in 5602us (5819us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788587318.799789:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:1.0:1788587318.803356:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587318.803461:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292143360 00000100:00100000:0.0:1788587318.803471:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292143360 00000100:00100000:0.0:1788587318.803558:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:0.0:1788587318.803568:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+23:15798:x1875469292143360:12345-192.168.203.14@tcp:36:dd.0 00010000:00010000:0.0:1788587318.803884:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.803902:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.803935:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587318.803991:0:16444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788587318.804016:0:16444:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c1942c7 reply state 00000000689e0225 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.804029:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587318.804038:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:0.0:1788587318.804040:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587318.804044:0:16444:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587318.804402:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+26:15798:x1875469292143360:12345-192.168.203.14@tcp:36:dd.0 Request processed in 833us (1110us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788587318.804410:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000020:00080000:0.0:1788587318.804416:0:16444:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788587318.806631:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587318.806814:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292143488 00000100:00100000:3.0:1788587318.806824:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292143488 00000100:00100000:3.0:1788587318.806883:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:3.0:1788587318.806893:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+26:15798:x1875469292143488:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:3.0:1788587318.806914:0:17774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587318.806935:0:17774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345056 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d0e expref: -99 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.806994:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345056 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d0e expref: 27 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.807008:0:17774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345056 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d0e expref: 27 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587318.807026:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:3.0:1788587318.807029:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587318.807033:0:17774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf2800, rc 0) 00000100:00100000:3.0:1788587318.807088:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+27:15798:x1875469292143488:12345-192.168.203.14@tcp:101:dd.0 Request processed in 197us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587318.807095:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:3.0:1788587318.817158:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.817281:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292143744 00000100:00100000:1.0:1788587318.817291:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292143744 00000100:00100000:1.0:1788587318.817356:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:1.0:1788587318.817367:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+27:15798:x1875469292143744:12345-192.168.203.14@tcp:103:dd.0 00010000:00010000:1.0:1788587318.817383:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587318.817408:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345056 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d0e expref: 27 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.817458:0:16427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:1.0:1788587318.817464:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587318.817523:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+26:15798:x1875469292143744:12345-192.168.203.14@tcp:103:dd.0 Request processed in 157us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587318.817530:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:1.0:1788587318.820464:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587318.820593:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292143872 00000100:00100000:2.0:1788587318.820606:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292143872 00000100:00100000:2.0:1788587318.820678:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:2.0:1788587318.820690:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+26:15798:x1875469292143872:12345-192.168.203.14@tcp:58:dd.0 00010000:00010000:2.0:1788587318.820865:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.820889:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587318.820906:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587318.823026:0:16442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587318.823205:0:16442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788587318.823289:0:16442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788587318.824122:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+26:15798:x1875469292143872:12345-192.168.203.14@tcp:58:dd.0 Request processed in 3427us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587318.824135:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:3.0:1788587318.827990:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587318.828095:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292144000 00000100:00100000:1.0:1788587318.828114:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292144000 00000100:00100000:1.0:1788587318.828179:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:1.0:1788587318.828189:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+26:15798:x1875469292144000:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:1.0:1788587318.828209:0:17774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587318.828240:0:17774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d15 expref: -99 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.828304:0:17774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.828317:0:17774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d15 expref: 27 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.828338:0:17774:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.828354:0:17774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d15 expref: 27 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.828369:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:1.0:1788587318.828385:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587318.828390:0:17774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d15 expref: 27 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587318.828399:0:17774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482400, rc 0) 00000100:00100000:1.0:1788587318.828473:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+27:15798:x1875469292144000:12345-192.168.203.14@tcp:101:dd.0 Request processed in 285us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587318.828482:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00010000:00010000:2.0:1788587319.084403:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587319.445393:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445456:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445496:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445531:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445556:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445575:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445594:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445611:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445632:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.445656:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292144640 00000100:00100000:2.0:1788587319.445664:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292144640 00000100:00100000:2.0:1788587319.445715:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292144512 00000100:00100000:2.0:1788587319.445718:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292144512 00000100:00100000:2.0:1788587319.445731:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292145152 00000100:00100000:2.0:1788587319.445733:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292145152 00000100:00100000:2.0:1788587319.445758:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292145024 00000100:00100000:2.0:1788587319.445761:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292145024 00000100:00100000:2.0:1788587319.445776:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788587319.445831:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587319.445835:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292144640:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587319.445847:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292144512:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587319.445911:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292144512:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.445912:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292144640:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 80us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587319.445927:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587319.445943:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788587319.445950:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788587319.445960:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2412:x1875469292145152:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587319.445975:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788587319.445986:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2412:x1875469292145024:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587319.445991:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2412:x1875469292145152:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587319.446000:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788587319.446023:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292144384 00000100:00100000:2.0:1788587319.446023:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2412:x1875469292145024:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 38us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587319.446030:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292144384 00000100:00100000:2.0:1788587319.446035:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788587319.446060:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292144896 00000100:00100000:2.0:1788587319.446064:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292144256 00000100:00100000:3.0:1788587319.446065:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292144896 00000100:00100000:2.0:1788587319.446071:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292144256 00000100:00100000:3.0:1788587319.446083:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292144768 00000100:00100000:3.0:1788587319.446088:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292144768 00000100:00100000:2.0:1788587319.446110:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:3.0:1788587319.446117:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:2.0:1788587319.446123:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292144384:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587319.446152:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292144384:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 35us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.446158:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:2.0:1788587319.446173:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:2.0:1788587319.446179:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+27:2412:x1875469292144256:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587319.446202:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+27:2412:x1875469292144256:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.446209:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:2.0:1788587319.446232:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:2.0:1788587319.446239:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+12:2412:x1875469292144768:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587319.446265:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+12:2412:x1875469292144768:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.446271:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:0.0:1788587319.447396:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292144128 00000100:00100000:0.0:1788587319.447407:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292144128 00000100:00100000:0.0:1788587319.447479:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 162 00000100:00100000:0.0:1788587319.447488:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2412:x1875469292144128:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587319.447536:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2412:x1875469292144128:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 50us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587319.447543:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 162 00000100:00080000:0.0:1788587319.447574:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587319.447579:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587319.447583:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587319.447595:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587319.447668:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2412:x1875469292144896:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587319.447711:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2412:x1875469292144896:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 52us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587319.447718:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000040:00080000:1.0:1788587319.467042:0:16478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788587319.467051:0:16478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587319.467088:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788587319.467094:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788587319.467296:0:16478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:16478:1875469310044032:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587319.467621:0:16478:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587319.475597:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.475733:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292145280 00000100:00100000:3.0:1788587319.475751:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292145280 00000100:00100000:3.0:1788587319.475843:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788587319.475868:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+28:15800:x1875469292145280:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788587319.475901:0:16442:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587319.476009:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+28:15800:x1875469292145280:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 143us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587319.476017:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:1.0:1788587319.477717:0:16478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:16478:1875469310044032:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587319.478690:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587319.479121:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292145408 00000100:00100000:1.0:1788587319.479130:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292145408 00000100:00100000:1.0:1788587319.479186:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:1.0:1788587319.479196:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+27:15800:x1875469292145408:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788587319.479376:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479395:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479409:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479554:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479561:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479567:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479589:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479596:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479602:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587319.479634:0:17774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788587319.479638:0:17774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587319.479651:0:17774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479661:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479668:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479674:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479690:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587319.479694:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479702:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479714:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf20ad1900) 00010000:00010000:1.0:1788587319.479847:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587319.479854:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479862:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483400/0x419e1ae1f634506b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479877:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479883:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479889:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479894:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587319.479896:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479902:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479920:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cbf03ac7200) 00010000:00010000:1.0:1788587319.479923:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587319.479926:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479932:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f6345072 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479947:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479954:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479959:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479964:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587319.479967:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479972:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479980:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:1.0:1788587319.479982:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587319.479985:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.479990:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f6345079 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587319.480082:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+27:15800:x1875469292145408:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 885us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587319.480280:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:2.0:1788587319.486389:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.486538:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292145664 00000100:00100000:3.0:1788587319.486546:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292145664 00000100:00100000:3.0:1788587319.486593:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:3.0:1788587319.486603:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+27:15800:x1875469292145664:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587319.486623:0:16442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587319.486642:0:16442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f6345080 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d1c expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.486872:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.486889:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.486901:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587319.486913:0:16442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587319.487154:0:16442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487162:0:16442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487168:0:16442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487173:0:16442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587319.487177:0:16442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487184:0:16442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487196:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:2.0:1788587319.487198:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587319.487203:0:16442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487209:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2800/0x419e1ae1f6345087 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487259:0:16442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f6345080 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d1c expref: 29 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487269:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf20ad1900) 00010000:00010000:2.0:1788587319.487271:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587319.487355:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3a00/0x419e1ae1f6345080 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d1c expref: 29 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.487366:0:16442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf3ccf3a00, rc 0) 00000100:00100000:2.0:1788587319.487514:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+28:15800:x1875469292145664:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 911us (1139us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788587319.487522:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:2.0:1788587319.492395:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.492510:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292145792 00000100:00100000:3.0:1788587319.492520:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292145792 00000100:00100000:3.0:1788587319.492577:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:3.0:1788587319.492587:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+28:15800:x1875469292145792:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587319.493386:0:16443:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587319.493487:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+28:15800:x1875469292145792:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 899us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.493495:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:2.0:1788587319.497717:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587319.497993:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292146048 00000100:00100000:0.0:1788587319.498004:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292146048 00000100:00100000:0.0:1788587319.498061:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:0.0:1788587319.498071:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+28:15800:x1875469292146048:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587319.498092:0:16444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587319.498113:0:16444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6345095 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d23 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587319.499066:0:16444:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1788587319.499075:0:16444:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788587319.499135:0:16444:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788587319.499558:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634509c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.499573:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634509c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.499586:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634509c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.499653:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f6345095 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d23 expref: 31 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.499673:0:16444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634509c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d23 expref: 30 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.499681:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf2c8be600) 00010000:00010000:0.0:1788587319.499684:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587319.499696:0:16444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f600, rc 0) 00000100:00100000:0.0:1788587319.499919:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+30:15800:x1875469292146048:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1847us (2271us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788587319.499928:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:0.0:1788587319.504852:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587319.506475:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292146304 00000100:00100000:1.0:1788587319.506490:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292146304 00000100:00100000:1.0:1788587319.507008:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:1.0:1788587319.507020:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+30:15800:x1875469292146304:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587319.507077:0:17774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587319.507104:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f634509c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d23 expref: 30 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507124:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf2c8be600) 00010000:00010000:1.0:1788587319.507136:0:17774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587319.507159:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507173:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507183:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507248:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507257:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507263:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507339:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507346:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507353:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507359:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587319.507363:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507370:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507379:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:1.0:1788587319.507381:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587319.507385:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507391:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483600/0x419e1ae1f63450aa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507400:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507405:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507410:0:17774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507422:0:17774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587319.507425:0:17774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507432:0:17774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507440:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x768a591 (ffff8cbf03ac7200) 00010000:00010000:1.0:1788587319.507442:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587319.507445:0:17774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.507450:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482800/0x419e1ae1f63450b1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x768a591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587319.507614:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+29:15800:x1875469292146304:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 596us (2770us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587319.507623:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:2.0:1788587319.511287:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.511479:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292146432 00000100:00100000:3.0:1788587319.511489:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292146432 00000100:00100000:2.0:1788587319.511644:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:2.0:1788587319.511655:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+29:15800:x1875469292146432:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587319.511673:0:16442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587319.511696:0:16442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18800/0x419e1ae1f63450b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d2a expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.511730:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63450bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.511743:0:16442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63450bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.511754:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63450bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.511893:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18800/0x419e1ae1f63450b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d2a expref: 31 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.511914:0:16442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63450bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d2a expref: 30 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.511924:0:16442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:2.0:1788587319.511927:0:16442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587319.511931:0:16442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c18e00, rc 0) 00000100:00100000:2.0:1788587319.511986:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+30:15800:x1875469292146432:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 332us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.511992:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:2.0:1788587319.515857:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.516316:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292146688 00000100:00100000:3.0:1788587319.516328:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292146688 00000100:00100000:3.0:1788587319.516389:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:3.0:1788587319.516401:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+30:15800:x1875469292146688:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587319.516488:0:16443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.516505:0:16443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.516516:0:16443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587319.518641:0:16443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788587319.518657:0:16443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 517267862698ns, next at 518267859546ns, rc = 0 00000004:00010000:3.0:1788587319.519420:0:16443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000122a060d reply state 0000000010c751d8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.519444:0:16443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.519454:0:16443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:3.0:1788587319.519457:0:16443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788587319.519461:0:16443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587319.520406:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+32:15800:x1875469292146688:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 3999us (4551us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788587319.520417:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:1.0:1788587319.530502:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587319.530602:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292146816 00000100:00100000:0.0:1788587319.530612:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292146816 00000100:00100000:0.0:1788587319.530672:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:0.0:1788587319.530681:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+32:15800:x1875469292146816:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587319.530703:0:16444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587319.530722:0:16444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d31 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.530834:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 33 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.530856:0:16444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 33 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.530876:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:0.0:1788587319.530880:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587319.530884:0:16444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e800, rc 0) 00000100:00100000:0.0:1788587319.530944:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+33:15800:x1875469292146816:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 263us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587319.530951:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:2.0:1788587319.534454:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.534547:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292146944 00000100:00100000:3.0:1788587319.534568:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292146944 00000100:00100000:3.0:1788587319.534627:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:3.0:1788587319.534637:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2409:x1875469292146944:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788587319.535074:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2409:x1875469292146944:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 438us (628us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788587319.535082:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:3.0:1788587319.542960:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.545857:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292147200 00000100:00100000:2.0:1788587319.545874:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292147200 00000100:00100000:2.0:1788587319.545954:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788587319.545964:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+33:15800:x1875469292147200:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587319.546207:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+34:15800:x1875469292147200:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 244us (3255us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788587319.546224:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788587319.550205:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.550448:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292147456 00000100:00100000:2.0:1788587319.550458:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292147456 00000100:00100000:2.0:1788587319.550573:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:2.0:1788587319.550586:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+34:15800:x1875469292147456:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788587319.550719:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+34:15800:x1875469292147456:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 136us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.550727:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:3.0:1788587319.554422:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587319.555119:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292147584 00000100:00100000:0.0:1788587319.555130:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292147584 00000100:00100000:0.0:1788587319.555191:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:0.0:1788587319.555224:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+34:15800:x1875469292147584:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587319.555244:0:16444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587319.555267:0:16444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63450d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d38 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.558124:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f63450db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.558148:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f63450db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.558162:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f63450db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587319.558207:0:16444:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587319.558238:0:16444:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f63450db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.558277:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f200/0x419e1ae1f63450d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d38 expref: 36 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.558297:0:16444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f63450db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d38 expref: 35 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.558307:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:0.0:1788587319.558310:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788587319.558313:0:16444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f600, rc 0) 00000100:00100000:0.0:1788587319.558427:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+35:15800:x1875469292147584:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 3214us (4014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587319.558776:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:0.0:1788587319.561832:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.561922:0:18542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292147712 00000100:00100000:2.0:1788587319.561932:0:18542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292147712 00000100:00100000:2.0:1788587319.561981:0:18542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788587319.561991:0:18542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2410:x1875469292147712:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587319.562008:0:18542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587319.562028:0:18542:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d3f expref: -99 pid: 18542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587319.562055:0:18542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bad37, blocks: 0x1 00010000:00010000:2.0:1788587319.562074:0:18542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=517s v=(0 0) 00010000:00010000:2.0:1788587319.562079:0:18542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587319.562088:0:18542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 7 pid: 18542 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.562239:0:18542:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 7 pid: 18542 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.562254:0:18542:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c18800, rc 0) 00000100:00100000:2.0:1788587319.562412:0:18542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:2410:x1875469292147712:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 421us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.562419:0:18542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:1.0:1788587319.572295:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.572377:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292147968 00000100:00100000:3.0:1788587319.572388:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292147968 00000100:00100000:3.0:1788587319.572489:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:3.0:1788587319.572499:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+35:15800:x1875469292147968:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587319.572613:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+35:15800:x1875469292147968:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 113us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587319.572621:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:2.0:1788587319.577201:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587319.578775:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292148096 00000100:00100000:0.0:1788587319.578787:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292148096 00000100:00100000:0.0:1788587319.578903:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:0.0:1788587319.578913:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+35:15800:x1875469292148096:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788587319.659250:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+35:15800:x1875469292148096:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 80327us (82049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587319.661657:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000001:00080000:1.0:1788587319.661710:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1788587319.661858:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788587319.661893:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788587319.661914:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788587319.662156:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662168:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662174:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662180:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.662184:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662191:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662208:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbf02c76000) 00010000:00010000:0.0:1788587319.662222:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587319.662226:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662232:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2e00/0x419e1ae1f6344f29 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662263:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662270:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662275:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662279:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.662282:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662288:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662297:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:0.0:1788587319.662299:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587319.662302:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662308:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf2c00/0x419e1ae1f6344f30 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662321:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662326:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662332:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662344:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.662348:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662354:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662363:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cbf03ac7f00) 00010000:00010000:0.0:1788587319.662366:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587319.662368:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662374:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f6344fd8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662389:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662395:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662400:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662404:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.662406:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662411:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662436:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:0.0:1788587319.662437:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587319.662440:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662445:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f634504f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662458:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662464:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662470:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662475:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.662477:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662482:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662488:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:0.0:1788587319.662491:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587319.662494:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.662499:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf3ccf3400/0x419e1ae1f63450c6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587319.662976:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587319.662994:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310044160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788587319.663058:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587319.663142:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310044160 00000100:00100000:3.0:1788587319.663149:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310044160 00000100:00100000:3.0:1788587319.663204:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788587319.663224:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf086f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310044160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788587319.663372:0:17750:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788587319.663376:0:17750:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788587319.663378:0:17750:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788587319.663380:0:17750:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788587319 -> 1788587319 00002000:00010000:3.0:1788587319.663383:0:17750:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788587319.663423:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf086f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469310044160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (364us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788587319.663452:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788587319.663738:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788587319.663770:0:3473:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe06895880/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788587319.663776:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310044160:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788587319.663978:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.663987:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.663994:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.663999:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587319.664002:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.664010:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.664023:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:2.0:1788587319.664026:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788587319.664030:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.664037:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f6344f7d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587319.666588:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.668052:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292148224 00000100:00100000:2.0:1788587319.668066:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292148224 00000100:00100000:2.0:1788587319.668124:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788587319.668134:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:2409:x1875469292148224:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788587319.668263:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:2409:x1875469292148224:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 129us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.668270:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:1.0:1788587319.672389:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.672532:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292148480 00000100:00100000:2.0:1788587319.672542:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292148480 00000100:00100000:2.0:1788587319.672644:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:2.0:1788587319.672655:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+14:15800:x1875469292148480:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587319.672730:0:17774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587319.672755:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f63450db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d38 expref: 14 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.672773:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:2.0:1788587319.672778:0:17774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587319.672856:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.672870:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.672881:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587319.673059:0:17774:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000910eeca9 reply state 000000002d197785 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.673073:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.673080:0:17774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:2.0:1788587319.673082:0:17774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587319.673085:0:17774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587319.673174:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+15:15800:x1875469292148480:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 520us (793us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788587319.673190:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:0.0:1788587319.677903:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.678016:0:18542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292148608 00000100:00100000:2.0:1788587319.678025:0:18542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292148608 00000100:00100000:2.0:1788587319.678116:0:18542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:2.0:1788587319.678127:0:18542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:2410:x1875469292148608:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788587319.678326:0:18542:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788587319.678330:0:18542:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788587318 00002000:00010000:2.0:1788587319.678332:0:18542:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788587318 00002000:00010000:2.0:1788587319.678334:0:18542:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788587319 -> 1788587318 00002000:00010000:2.0:1788587319.678336:0:18542:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788587319.678397:0:18542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:105a14ca-5728-4c79-85fc-db7f7cf354e5+8:2410:x1875469292148608:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 270us (501us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788587319.678405:0:18542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:1.0:1788587319.682478:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.682558:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292148736 00000100:00100000:3.0:1788587319.682568:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292148736 00000100:00100000:3.0:1788587319.682624:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788587319.682634:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+8:2409:x1875469292148736:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788587319.682676:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682693:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587319.682697:0:17753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587319.682704:0:17753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682717:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682747:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682755:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682764:0:17753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682771:0:17753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587319.682787:0:17753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682832:0:17753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682847:0:17753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.682855:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9cb961/0x419e1ae1f63450f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587319.682916:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+8:2409:x1875469292148736:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 284us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587319.682924:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:1.0:1788587319.686206:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587319.686348:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292148992 00000100:00100000:0.0:1788587319.686356:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292148992 00000100:00100000:0.0:1788587319.686414:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:0.0:1788587319.686424:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+15:15800:x1875469292148992:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788587319.686502:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.686519:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.686531:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.686768:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.686779:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 16 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.686787:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.686862:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 16 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.686877:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 16 pid: 16444 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587319.686903:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16444:1875469310044288:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587319.686974:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ff840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587319.689483:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16444:1875469310044288:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587319.689511:0:16444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587319.690119:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587319.690188:0:18483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292149120 00000100:00100000:0.0:1788587319.690195:0:18483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292149120 00010000:00010000:0.0:1788587319.690242:0:18483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 17 pid: 16444 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587319.690280:0:18483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:0.0:1788587319.690290:0:18483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+17:2410:x1875469292149120:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587319.690304:0:18483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587319.690311:0:18483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 17 pid: 16444 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.690322:0:18483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 17 pid: 16444 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.690344:0:18483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e800/0x419e1ae1f63450cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d31 expref: 17 pid: 16444 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.690361:0:18483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:0.0:1788587319.690366:0:18483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.690375:0:18483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.690398:0:18483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.690426:0:18483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587319.690477:0:18483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+16:2410:x1875469292149120:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 188us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587319.690484:0:18483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00010000:00010000:1.0:1788587319.690707:0:16444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587319.690715:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587319.690940:0:16444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788587319.691076:0:16444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788587319.691122:0:16444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788587319.691202:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:16444:1875469310044416:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788587319.691262:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587319.691299:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf04c66f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587319.691360:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310044416 00000100:00100000:2.0:1788587319.691365:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310044416 00000100:00100000:2.0:1788587319.691409:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587319.691417:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16444:x1875469310044416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788587319.691483:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16444:x1875469310044416:12345-0@lo:1000:mdt00_002.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.691490:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788587319.694012:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:16444:1875469310044416:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788587319.694707:0:16444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788587319.694788:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:16444:1875469310044544:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788587319.695468:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587319.695551:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ffb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587319.695700:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310044544 00000100:00100000:2.0:1788587319.695708:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310044544 00000100:00100000:2.0:1788587319.695816:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587319.695827:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16444:x1875469310044544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788587319.696049:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16444:x1875469310044544:12345-0@lo:1000:mdt00_002.0 Request processed in 224us (839us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788587319.696063:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788587319.696148:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:16444:1875469310044544:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788587319.696183:0:16444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696192:0:16444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696200:0:16444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696205:0:16444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ee00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.696219:0:16444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696235:0:16444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696262:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:0.0:1788587319.696266:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587319.696270:0:16444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696277:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ee00/0x419e1ae1f63450fe lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696307:0:16444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696314:0:16444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696320:0:16444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696336:0:16444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.696339:0:16444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696344:0:16444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696351:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:0.0:1788587319.696353:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587319.696359:0:16444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d15 expref: 19 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696369:0:16444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d15 expref: 19 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696384:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d15 expref: 19 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.696420:0:16444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d15 expref: 19 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587319.696433:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16444:1875469310044672:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788587319.696498:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ffb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587319.701705:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587319.702000:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16444:1875469310044672:192.168.203.14@tcp:105: 00010000:00010000:0.0:1788587319.702030:0:16444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702041:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19400/0x419e1ae1f634505d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702072:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702086:0:16444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702097:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702107:0:16444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702113:0:16444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702134:0:16444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702140:0:16444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.702144:0:16444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702153:0:16444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702164:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:0.0:1788587319.702167:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587319.702171:0:16444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702176:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345105 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702188:0:16444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702194:0:16444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702200:0:16444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702205:0:16444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587319.702208:0:16444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702292:0:16444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702301:0:16444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:0.0:1788587319.702304:0:16444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587319.702307:0:16444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.702312:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f63450f7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16444 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587319.702527:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+19:15800:x1875469292148992:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 16104us (16329us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788587319.702537:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000020:00080000:0.0:1788587319.702542:0:16444:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788587319.702666:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292149248 00000100:00100000:2.0:1788587319.702674:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292149248 00000100:00100000:2.0:1788587319.702725:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788587319.702736:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41b09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+19:15798:x1875469292149248:12345-192.168.203.14@tcp:49:dd.0 00000100:00100000:2.0:1788587319.702865:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41b09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+19:15798:x1875469292149248:12345-192.168.203.14@tcp:49:dd.0 Request processed in 131us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587319.702872:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000040:00080000:1.0:1788587319.703095:0:16478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788587319.703101:0:16478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587319.703152:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788587319.703161:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788587319.707725:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587319.707886:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292149504 00000100:00100000:2.0:1788587319.707896:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292149504 00000100:00100000:2.0:1788587319.709487:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788587319.709507:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+19:15800:x1875469292149504:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788587319.710208:0:16446:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788587319.710400:0:16446:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788587319.710444:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.710461:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.710473:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.710483:0:16446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.710490:0:16446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.710507:0:16446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587319.710534:0:16446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587319.710624:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:15800:x1875469292149504:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 1123us (2905us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788587319.710633:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000020:00080000:2.0:1788587319.710638:0:16446:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788587319.712841:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587319.712854:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.712865:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587319.712870:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.712880:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.712899:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:3.0:1788587319.712902:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788587319.712921:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.712928:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19e00/0x419e1ae1f634510c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.712944:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587319.712945:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587319.712947:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587319.845891:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.845930:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.845974:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587319.846127:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292149632 00000100:00100000:0.0:1788587319.846137:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292149632 00000100:00100000:0.0:1788587319.846184:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292149760 00000100:00100000:0.0:1788587319.846188:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292149760 00000100:00100000:0.0:1788587319.846202:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292149888 00000100:00100000:0.0:1788587319.846204:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292149888 00000100:00100000:0.0:1788587319.846232:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:0.0:1788587319.846324:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+10:2411:x1875469292149632:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:0.0:1788587319.846360:0:17756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.846381:0:17756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 10 pid: 18542 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.846409:0:17756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587319.846413:0:17756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587319.846418:0:17756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.846453:0:17756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 10 pid: 18542 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.846467:0:17756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 10 pid: 18542 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587319.846482:0:17756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:17756:1875469310044800:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587319.846566:0:17756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ffb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587319.851641:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587319.851739:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292150016 00000100:00100000:3.0:1788587319.851750:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292150016 00010000:00010000:3.0:1788587319.851832:0:16427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 11 pid: 18542 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587319.851874:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:3.0:1788587319.851886:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+11:2410:x1875469292150016:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587319.851901:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587319.851922:0:16427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 11 pid: 18542 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.851937:0:16427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 11 pid: 18542 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.852102:0:16427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587319.852108:0:16427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587319.852128:0:16427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.852138:0:16427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587319.852158:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587319.852206:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+11:2410:x1875469292150016:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 322us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587319.854331:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:1.0:1788587319.854664:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587319.854681:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe04fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310044928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587319.854746:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587319.854791:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310044928 00000100:00100000:1.0:1788587319.854818:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310044928 00000100:00100000:1.0:1788587319.854860:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587319.854869:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3472:x1875469310044928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587319.854906:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587319.854952:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3472:x1875469310044928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587319.854970:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587319.855010:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe04fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310044928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788587319.855898:0:17756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ba3195/0x419e1ae1f63450e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d3f expref: 10 pid: 18542 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587319.855919:0:17756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:17756:1875469310044800:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587319.855940:0:17756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.855950:0:17756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.858293:0:17756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587319.938722:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1788587319.939138:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1788587319.939364:0:17756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1788587319.939370:0:17756:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788587318 -> 1788587319 00002000:00010000:0.0:1788587319.939373:0:17756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1788587319.939388:0:17756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.939401:0:17756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.939411:0:17756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.939419:0:17756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587319.939436:0:17756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.939446:0:17756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.939467:0:17756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.939475:0:17756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f6345113 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587319.939581:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+8:2411:x1875469292149632:12345-192.168.203.14@tcp:4:dd.0 Request processed in 93334us (93693us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788587319.939605:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:0.0:1788587319.939635:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:0.0:1788587319.939647:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:2411:x1875469292149760:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:0.0:1788587319.939686:0:17756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a9bad37, atime: 0x6a9bad36, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1788587319.939692:0:17756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.939703:0:17756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788587319.939707:0:17756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587319.939713:0:17756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587319.939726:0:17756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587320.003396:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1788587320.003467:0:17756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1788587320.003472:0:17756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1788587320.003486:0:17756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.003499:0:17756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.003524:0:17756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.003531:0:17756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587320.003536:0:17756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.003545:0:17756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.003564:0:17756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.003572:0:17756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f634511a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587320.003670:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+6:2411:x1875469292149760:12345-192.168.203.14@tcp:4:dd.0 Request processed in 64021us (157732us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788587320.003684:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:1.0:1788587320.003713:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:1.0:1788587320.003724:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292149888:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:1.0:1788587320.003759:0:17756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9bad37, atime: 0x6a9bad36, ctime: 0x0, blocks: 0x1007 00010000:00010000:1.0:1788587320.003765:0:17756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.003786:0:17756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=517s v=(0 0) 00010000:00010000:1.0:1788587320.003791:0:17756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587320.003830:0:17756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.003843:0:17756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587320.048049:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1788587320.048129:0:17756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1788587320.048135:0:17756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788587320.048150:0:17756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.048165:0:17756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.048174:0:17756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.048199:0:17756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587320.048205:0:17756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.048225:0:17756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.048243:0:17756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.048252:0:17756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345121 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587320.048349:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292149888:12345-192.168.203.14@tcp:4:dd.0 Request processed in 44623us (202369us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788587320.048358:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:2.0:1788587320.053062:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587320.053152:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292150144 00000100:00100000:0.0:1788587320.053162:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292150144 00000100:00100000:0.0:1788587320.053229:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788587320.053240:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292150144:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:0.0:1788587320.053287:0:17758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9bad37, atime: 0x6a9bad36, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1788587320.053296:0:17758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.053311:0:17758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788587320.053329:0:17758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587320.053336:0:17758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.053352:0:17758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587320.057362:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587320.057410:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587320.057465:0:17756:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587320.057476:0:17756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788587320.057780:0:17757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587320.057817:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292150272 00000100:00100000:1.0:1788587320.057827:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292150272 00000100:00100000:1.0:1788587320.057873:0:17757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587320.057879:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292150400 00000100:00100000:1.0:1788587320.057881:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292150400 00000100:00100000:0.0:1788587320.058578:0:19306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788587320.058591:0:19306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:2412:x1875469292150272:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:0.0:1788587320.058626:0:19306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.058642:0:19306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587320.058646:0:19306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587320.058652:0:19306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.058666:0:19306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587320.059707:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587320.059783:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587320.059876:0:17757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788587320.059968:0:17756:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788587320.059992:0:17757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788587320.060316:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292150528 00000100:00100000:0.0:1788587320.060325:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292150528 00000100:00100000:0.0:1788587320.060369:0:17757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788587320.060374:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292150656 00000100:00100000:0.0:1788587320.060376:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292150656 00000100:00100000:1.0:1788587320.061646:0:19307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:1.0:1788587320.061663:0:19307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:105a14ca-5728-4c79-85fc-db7f7cf354e5+10:2412:x1875469292150400:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:1.0:1788587320.061701:0:19307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.061718:0:19307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587320.061722:0:19307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587320.061728:0:19307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.061756:0:19307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587320.104314:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1788587320.104648:0:19306:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:0.0:1788587320.104654:0:19306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788587320.104668:0:19306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.104681:0:19306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.104690:0:19306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.104698:0:19306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587320.104703:0:19306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.104711:0:19306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.104730:0:19306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.104738:0:19306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f634512f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587320.104939:0:19306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+15:2412:x1875469292150272:12345-192.168.203.14@tcp:4:dd.0 Request processed in 46347us (47581us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788587320.104951:0:19306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788587320.104996:0:19306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:0.0:1788587320.105007:0:19306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+14:2411:x1875469292150528:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:0.0:1788587320.105040:0:19306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.105053:0:19306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587320.105057:0:19306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587320.105064:0:19306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.105077:0:19306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.110822:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587320.139940:0:19307:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788587320.139951:0:19307:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 0 -> 1788587319 00002000:00010000:1.0:1788587320.139953:0:19307:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1788587320.139969:0:19307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.139983:0:19307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.139992:0:19307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.140000:0:19307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587320.140005:0:19307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.140015:0:19307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.140035:0:19307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.140063:0:19307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072fcdcb0/0x419e1ae1f6345136 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587320.140191:0:19307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:105a14ca-5728-4c79-85fc-db7f7cf354e5+16:2412:x1875469292150400:12345-192.168.203.14@tcp:4:dd.0 Request processed in 78528us (82775us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788587320.140201:0:19307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:1.0:1788587320.140241:0:19307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788587320.140253:0:19307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:105a14ca-5728-4c79-85fc-db7f7cf354e5+15:2411:x1875469292150656:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:1.0:1788587320.140283:0:19307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.140294:0:19307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587320.140299:0:19307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587320.140305:0:19307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.140316:0:19307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587320.140585:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1788587320.143846:0:17758:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1788587320.143867:0:17758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.143879:0:17758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.143888:0:17758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.143895:0:17758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ee00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587320.143900:0:17758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.143925:0:17758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.143946:0:17758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587320.143954:0:17758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b09a8288/0x419e1ae1f6345128 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587320.144036:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+11:2412:x1875469292150144:12345-192.168.203.14@tcp:4:dd.0 Request processed in 90793us (90978us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788587320.144045:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000001:00080000:2.0:1788587320.175363:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1788587320.181159:0:19306:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788587320.181170:0:19306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788587320.181186:0:19306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587320.181199:0:19306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587320.181221:0:19306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587320.181228:0:19306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587320.181233:0:19306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587320.181261:0:19306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587320.181281:0:19306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587320.181290:0:19306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634513d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587320.181400:0:19306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+9:2411:x1875469292150528:12345-192.168.203.14@tcp:4:dd.0 Request processed in 76391us (121693us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788587320.181416:0:19306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00010000:00010000:1.0:1788587320.205786:0:19307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.205850:0:19307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.205876:0:19307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.205884:0:19307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587320.205889:0:19307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.205899:0:19307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.205919:0:19307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587320.205928:0:19307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345144 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587320.206020:0:19307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:105a14ca-5728-4c79-85fc-db7f7cf354e5+7:2411:x1875469292150656:12345-192.168.203.14@tcp:4:dd.0 Request processed in 65766us (146232us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788587320.206030:0:19307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000001:00080000:2.0:1788587320.206709:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934606 is committed 00000100:00100000:0.0:1788587320.877073:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310045184:0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.877118:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310045440:0@lo:400:kworker.0 00000100:00100000:1.0:1788587320.877201:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310045312:0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.877488:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310045056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587320.878523:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.878531:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587320.878582:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469310045696:0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.878583:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310045952:0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.878625:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.878645:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469310046464:0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.878668:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.878692:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310046976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587320.878713:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.878748:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310045184 00000100:00100000:2.0:1788587320.878756:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310045184 00000100:00100000:0.0:1788587320.878766:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.878817:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788587320.878834:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3475:x1875469310045184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.878880:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3475:x1875469310045184:12345-0@lo:400:kworker.0 Request processed in 49us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587320.878887:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788587320.878920:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310045440 00000100:00100000:2.0:1788587320.878924:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310045440 00000100:00100000:2.0:1788587320.878948:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310045952 00000100:00100000:2.0:1788587320.878951:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310045952 00000100:00100000:2.0:1788587320.878988:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587320.878997:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310045440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587320.879000:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310046208:0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.879040:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310045440:12345-0@lo:400:kworker.0 Request processed in 44us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587320.879047:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587320.879053:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.879065:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587320.879073:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310045952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587320.879084:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310046720:0@lo:400:kworker.0 00000100:00100000:1.0:1788587320.879085:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.879101:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310045952:12345-0@lo:400:kworker.0 Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587320.879108:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587320.879114:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310045824:0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.879128:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310046976 00000100:00100000:2.0:1788587320.879133:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310046976 00000100:00100000:1.0:1788587320.879144:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.879154:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587320.879159:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310046976:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587320.879161:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310046336:0@lo:400:kworker.0 00002000:00000024:2.0:1788587320.879174:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62849024 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1788587320.879198:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310045312 00000100:00100000:2.0:1788587320.879200:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310046976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587320.879214:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310045312 00000100:00100000:2.0:1788587320.879219:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587320.879235:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310045824 00000100:00100000:1.0:1788587320.879238:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310045824 00000100:00100000:2.0:1788587320.879250:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310046464 00000100:00100000:1.0:1788587320.879251:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587320.879253:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310046464 00000100:00100000:1.0:1788587320.879256:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310045312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.879275:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310045696 00000100:00100000:2.0:1788587320.879278:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310045696 00000100:00100000:2.0:1788587320.879289:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310046208 00000100:00100000:2.0:1788587320.879292:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310046208 00000100:00100000:1.0:1788587320.879293:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310045312:12345-0@lo:400:kworker.0 Request processed in 37us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587320.879300:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587320.879303:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788587320.879308:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469310046464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587320.879310:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587320.879315:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310045824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.879337:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469310046464:12345-0@lo:400:kworker.0 Request processed in 28us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587320.879337:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310045824:12345-0@lo:400:kworker.0 Request processed in 21us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587320.879343:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788587320.879354:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587320.879355:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587320.879360:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469310045696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.879386:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469310045696:12345-0@lo:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587320.879391:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587320.879395:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788587320.879401:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310046208:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788587320.879406:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587320.879410:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587320.879444:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310046976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587320.879445:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.879461:0:3473:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1788587320.879467:0:3473:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe06895880, transno 8589934596 00000004:00080000:2.0:1788587320.879480:0:3473:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1788587320.879500:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310045440:0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.879511:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310045952:0@lo:400:kworker.0 00010000:00080000:2.0:1788587320.879522:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c0380 x1875469310046464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587320.879533:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469310046464:0@lo:400:kworker.0 00000100:00100000:0.0:1788587320.879546:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3475:1875469310045184:0@lo:400:kworker.0 00000100:00100000:0.0:1788587320.879563:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469310045696:0@lo:400:kworker.0 00000100:00100000:0.0:1788587320.879593:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310046720 00000100:00100000:0.0:1788587320.879604:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310046720 00000100:00100000:0.0:1788587320.879651:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788587320.879658:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469310046720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587320.879714:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469310046720:12345-0@lo:400:kworker.0 Request processed in 56us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587320.879722:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788587320.879738:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587320.879752:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587320.879784:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310046848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587320.879832:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587320.880036:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310046848 00000100:00100000:2.0:1788587320.880041:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310046848 00000100:00100000:2.0:1788587320.880069:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587320.880075:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310046848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587320.880080:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310046208:12345-0@lo:400:kworker.0 Request processed in 680us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587320.880086:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00002000:00000024:2.0:1788587320.880097:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587320.880097:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310046336 00000100:00100000:1.0:1788587320.880100:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310046336 00000100:00100000:1.0:1788587320.880123:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587320.880126:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310046848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587320.880128:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310046336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587320.880133:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587320.880157:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310046336:12345-0@lo:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587320.880162:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587320.880220:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310046208:0@lo:400:kworker.0 00010000:00080000:1.0:1788587320.880234:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c0000 x1875469310046720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587320.880243:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310046720:0@lo:400:kworker.0 00000100:00080000:1.0:1788587320.880268:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587320.880272:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587320.880306:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587320.880337:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310045568:0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.880358:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587320.880376:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310046080:0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.880395:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587320.880402:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310045056 00000100:00100000:3.0:1788587320.880410:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469310046592:0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.880433:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587320.880462:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310045568 00000100:00100000:3.0:1788587320.880466:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310045568 00000100:00100000:3.0:1788587320.880489:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310046080 00000100:00100000:3.0:1788587320.880492:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310046080 00000100:00100000:3.0:1788587320.880513:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587320.880519:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310045568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.880554:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310045568:12345-0@lo:400:kworker.0 Request processed in 35us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587320.880571:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587320.880584:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788587320.880590:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310046080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.880621:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310046080:12345-0@lo:400:kworker.0 Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587320.880626:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587320.880641:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310045312:0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.880642:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310046592 00000100:00100000:3.0:1788587320.880647:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310046592 00000100:00100000:3.0:1788587320.880675:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587320.880675:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310045824:0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.880686:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469310046592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587320.880703:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310046336:0@lo:400:kworker.0 00000100:00100000:0.0:1788587320.880726:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310046848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587320.880727:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469310046592:12345-0@lo:400:kworker.0 Request processed in 41us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587320.880738:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788587320.880749:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310045056 00000100:00100000:3.0:1788587320.880775:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310045568:0@lo:400:kworker.0 00000100:00100000:1.0:1788587320.880775:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587320.880782:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310045056:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587320.880785:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310046080:0@lo:400:kworker.0 00000100:00100000:3.0:1788587320.880814:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469310046592:0@lo:400:kworker.0 00002000:00000024:1.0:1788587320.880814:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788587320.880822:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587320.880828:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587320.880852:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310045056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587320.880860:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788587320.880864:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310045056:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788587321.131977:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587321.387962:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310047104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587321.388030:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587321.388510:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310047104 00000100:00100000:0.0:1788587321.388655:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310047104 00000100:00100000:0.0:1788587321.388705:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587321.388715:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310047104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587321.388756:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587321.388832:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310047104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587321.388840:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788587321.388881:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310047104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587321.389163:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310047232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587321.389196:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587321.389310:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310047232 00000100:00100000:1.0:1788587321.389315:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310047232 00000100:00100000:1.0:1788587321.389377:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587321.389385:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310047232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587321.389414:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587321.389500:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310047232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587321.389507:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587321.389996:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310047232:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788587321.533463:0:19344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788587322.154975:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41716 lines, 41716 kept, 0 dropped, 0 bad.